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Executive Summary 



Despite the longest peacetime economic expansion in this century, disad- 
vantaged youth continue to have what most experts consider unaccept- 
ably high unemployment rates. Deficiencies in reading, writing, and 
mathematics skills keep many such youth from getting and holding jobs 
that will lift them out of poverty. In 1986, to help address these prob- 
lems, the Congress amended the Summer Youth Employment and Train- 
ing Program, which is specifically targeted to disadvantaged youth, to 
require that local summer programs include assessment of educational 
deficiencies and remedial education, along with work experience. The 
Chairman of the Subcommittee on Employment and Productivity, Senate 
Committee on Labor and Human Resources, asked gag to examine how 
the recently enacted requirem3nt to provide remedial education in this 
program was being implemented. 



Background Authorized under title II-B of the Job Training Partnership Act, the sum- 

^ mer youth program is administered by the Department of Labor, which 

provides general guidance and allocates funds to slates and territories. 
They in turn fund individual local programs to pay youths' wages and 
provide a variety of services. In 1987, the first year for this remediation 
requirement, the summer program was funded at $636 million and 
served about 621,000 youth. The objectives of the summer program are 
to (1) enhance the basic educational skills of economically disadvan- 
taged youth, (2) encourage them to complete school, and (3) familiarize 
them with the world of work. 



Results in Brief Localities expanded the use of remedial education in their summer 

youth programs as a result of the 1986 amendments. In 1987, the 
number of youth provided remedial education increased from 55,000 to 
112,000 and the money spent on remediation expanded from $37 to $64 
million. While every program surveyed provided some remediation, the 
number of youth served and the intensity varied greatly. The majority 
of programs reported plans to further expand remediation in 1988. 

Programs said that they systematically evaluated the impact of 
remediation, and 60 percent of the administrators believed that 
remediation improved their summer programs. However, because of 
varying program goals and differing evaluation methods, GAG could not 
determine the overall effectiveness of enhanced remediation. 

Local officials had anticipated that adding remedial education would 
require reductions in the number of youth served, the average hours of 
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work experience given each youth, or the number of worksites in the 
programs. Although such reductions were reported, they were less fre- 
quent than had been anticipated. The overall decrease in summer pro- 
gram funding likely also played a significant role. 



Principal Findings 



Compared with the 1986 summer youth programs, the number of reme- 
dial education participants more than doubled in 1987, and the total 
funds spent on remediation increased by 73 percent. Of programs that 
provided remediation in 1986, 67 percent increased the number of youth 
in such programs and 69 percent increased the share of their summer 
funds spent on remediation. These increases came in a year when funds 
declined for about three-quarters of all programs. 

All programs surveyed provided some remediation, but the extent 
varied greatly. Participants receiving remediation ranged from 1 percent 
of those in the summer program in one locality to 100 percent in 
another. About 13 percent provided remediation to more than half of 
their participants, while 55 percent provided remediation to less than 20 
percent of participants. About 20 percent of all participants received 
remediation. These youth received an average of 90 hours of remedia- 
tion during the summer, again ranging from 5 hours in one local pro- 
gram to 280 hours in another. 

Citing general satisfaction with the remediation component, about 70 
percent of the programs planned to spend more money on remediation 
or provide remediation to more youth in 1988, while about 5 percent 
anticipated reductions. 



In changing the program, the Congress specified in the amendments that 
eligible participants' reading and mathematics skills be assessed. Labor 
informed local programs that all participants must be assessed. On aver- 
age, program officials reported assessing about 90 percent of their par- 
ticipants. These assessments were critical in decisions on who would 
receive remediation, the officials said. Thirteen percent reported assess- 
ing fewer than 90 percent of participants, while a dozen assessed fewer 
than half. Reasons given for this included limiting assessment to youth 
(1) of certain ages or (2) in certain geographic locations, for whom 



Remedial Education 
Greatly Increased 



Needs Assessments 
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remediation was planned. A minority of programs experienced difficulty 
in the assessment process. For example, 9 percent reported problems in 
getting grades and test scores from local school systems. 



Who Is Served? While remediation (and the overall summer youth program) serves some 

school drop-outs, it is targeted to younger in-school youth, with many 
from welfare households: 

• the average age was 16 (43 percent were under 16), 

• 4 percent were school drop-outs, and 

• 34 percent were from families receiving Aid to Families With Dependent 
Children. 



Successes Reported but ^^^^ three-fourths of the programs (79 percent) used pre- and post-pro- 
Effectiveness Unknown gram testing to evaluate progress. Most reported gains in math and 

reading skills and felt that remediation improved their summer pro- 
grams. However, program goals and evaluation approaches varied 
widely, and certain* programs' goals such as improved behavior or a 
more positive attitude were unmeasurable. Thus, the programs' overall 
effectiveness could not be determined. Other useful information was 
often lacking — only 39 percent of programs attempted to determine 
whether participants either returned to school or obtained jobs. 



Overall Program 
Reductions Were 
Significant but Anticipated 



Prior to the 1987 summer program, many local administrators antici- 
pated service reductions in several aspects of their summer programs 
due to the cost of adding the remedial component. However, somewhat 
fewer programs actually reported making such reductions, as shown in 
table 1. 



Table 1: Anticipated and Actual Program 
Reductions 



Reductions (percent 



Program element 


Anticipated 


Made 


Hours of work experience 


76 


63 


Number of worksites 


52 


40 


Number of program participants 


49 


45 



6 
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Matters for 

Congressional 

Consideration 



Although most local program administrators believe the remediation 
component of the summer youth program has been successful, the com- 
ponent's actual effectiveness is unknown. The Congress may, therefore, 
wish to consider requiring Labor to evaluate all or a sample of summer 
youth remediation programs, using standardized educational achieve- 
ment tests and testing procedures. 



And, while nearly all service delivery areas have added remediation as 
required, the proportion of youth receiving services and the extent of 
these services vary greatly. Thus, the Congress may also wish to con- 
sider requiring that 

the Department of Labor define some minimal amount of remediation 

that must be provided during the summer and 

all youth in the program who need remedial education receive it. 



Agency Comments 



GAG did not obtain formal comments on this report. However, a draft 
was discussed with Department of Labor officials and their suggestions 
were considered. 
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Chaptei* 1 



Introduction 



Despite the longest peacetime economic expansion in this century, disad- 
vantaged youth continue to have what most experts consider unaccept- 
ably high unemployment rates. These economically disadvantaged 
youth have chronically encountered difficulty in getting and keeping 
jobs that will lift them out of poverty, often because of deficiencies in 
reading, writing, or mathematics skills. Research also shows that aca- 
demically deficient youth are more likely to drop out of school. The 
Summer Youth Employment and Training Program (sv'etp), a federally 
funded job training program for economically disadvantaged youth, 
seeks in part to address these deficiencies. 



Background objectives of s^etp are to (1) enhance basic educational skills, (2) 

^ encourage school completion, and (3) expose youth to the world of work. 

Economically disadvantaged individuals J4-21 years old are eligible to 
participate. 

Authorized under title II-B of the Job Training Partnership Act (jtpa) 
(P.L. 97-300), the summer youth program is administered by the Depart- 
ment of Labor's Employment and Training Administration. Labor allo- 
cates money to states and territories, which in turn fund service 
delivery areas (Sdas) that operate the programs. The 1987 summer pro- 
gram was funded at $636 million and served about 6?' ,000 youth. 
Funds are used for (1) wages and stipends to youth .id (2) program 
services, such as staff and materials. 

Remedial education had been a component of many local programs, but 
in 1986 the Congress amended jtpa to require that all sdas spend at least 
some money for remediation. Beginning in 1987, local programs were 
required to assess the reading and mathematics skills of their partici- 
pants and provide some level of remediation. The legislation does not 
require that any specific number of youth receive remediation or that 
any specific amount of funds be expended for remediation. Senator Paul 
Simon, Chairman of the Subcommittee on Employment and ^Productivity, 
Committee on Labor and Human Rest urces, asked us to review how the 
SDAS planned to provide remediation a:, part of their 19C7 programs, 
their sources of assistance in doing so and any problems encountered in 
developing plans, what they expected the educational component to look 
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like, and how it compared with remedial education they may have pro- 
vided in 1986 before enactme^^f of the legislative requirement. In 
response to the request, we n orted in June 19SV that 

• local school districts were a primary source of advice and assistance bo 
SDAS in overcoming planning obstacles as well as providing remediation 
services, 

• the amount of money spent on remediation was expected to increase sig- 
nificantly and the number of youth receiving remediation to increase by 
more than 100 percent over the 1986 level, and 

• SDAS considered the federal requirement to provide remediation to be 
appropriate but said it would cause reductions in other parts of the 
program. 



Subsequent to that report, the Subcoramittee asked us to determine how 
SDAS implemented the requirement for remediation in their summer 
youth programs, how their actual programs may have differed from 
those planned, and what problems they encountered in providing 
remediation. To respond to this request, we interviev/ed program offi- 
cials at 200 SDAS (listed in app. I) in 4d states and u.e District of Colum- 
bia.- These 200 were selected from a universe of 568 sdas that planned 
to serve the same geographic area in 1987 as In 1986. Also, to compare 
SDAS with vaiying proportions of urban populations, we randomly 
selected sdas from three groups with different percentages of population 
living in areas defined as urban by the Census Bureau. Sample selection, 
sampling errors, and survey development are described in more detail in 
appendix II. 

We c '^ducted interviews by telephone. In most cases, we interviewed 
the same person v/hom we had contacted for cur previous report. This 
person had been identified by both the SDA director and himself or her- 
self as the person most knowledgeable about the remedial education 
efforts in their summer youth program. In the few cases where the per- 
son originally contacted was no longer associated with the SDA or now 
functioned in a different capacity, we interviewed the individual who 
had assumed that position. We completed over 90 percent of our calls 



' Job Training l\artnership Act Summer Youth Pro)*rams !ncrc«nsc Emphasis on Hdiration (GAG/ 
HRD-87-10113K, June3U. 1987). 

-These were the same 200 SDAs that we contiictcd in our uutial review of SDAs' pljins to provide 
remediation. This enabled us to con pare phinned and actual services. 



Objectives, Scope, and 
Methodology 
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between December 7, 1987, and January 15, 1988. We used a combina- 
tion of steps to verify, where possible, the accuracy of the information 
obtained in the interviews. 

In addition, we conducted an extensive set of internal checks to locate 
inconsistencies or extreme values that indicated information that might 
have been inaccurately recorded. Where such inconsistencies were 
found, we made follow-up telephone calls for clarification. We also com- 
pared several kinds of data obtained through telephone interviews to 
data obtained in other paits of this review and the previous review. 

To obtain a more complete picture of how remedial education was being 
provided, we visited nine sdas (see fig. 1.1 for their locations). They 
were judgmentally selected after we cor^sidered such factors as geo- 
graphic location, whether they had provided remediation piior to 1987, 
number and type of entities providing remediation, number of partici- 
pants in the summer program and remediation, method of instruction 
used, the urban/rural mix of the population to be served, program fund- 
ing levels, and estimated funding levels for remediation. Efforts by the 
nine sdas to provide remediation for summer program participants are 
summarized in appendix III. 

To better understand how the nine sdas provided remedial education 
and to verify the accuracy and reasonableness of information we 
obtained, we conducted a series of structured interviews. Those inter- 
viewed included local officials responsible for administering the summer 
youth program, employers of youth in remediation, instructors in the 
remedial program, and participating youth. We also interviewed repre- 
sentatives of the private industry councils, which are sdas' governing 
bodies, and observed remedial education classes and work sites. 

After obtaining statistics on the numbers of program participants and 
demographic characteristics at both the sda and state level, we com- 
pared this information and reconciled differences. 

Our review was performed in accordance with generally accepted gov- 
ernment auditing standards between June 1987 and June 1988. 

As requested by the Subcommittee, we did not obtain formal comments 
on this report from the Department of Labor. However, a draft was dis- 
cussed with Department officials and their oral comments were consid- 
ered in finalizing the report. The summaries of the • .ine programs' 




Page 1 2 I ^ GAO/IfflD-88-1 18 Remedial Education in Summer Jobs Program 



Chapter 1 
Introduction 



remedial components were also discussed with program officials, and we 
made changes where appropriate. 



Figure Locations of SDAs Visited by GAO 
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Carrizo Springs. TX 
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Fort Meyers, FL 
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Job Training Partnership Act: Remedial 
Education in the Summer Jobs Program 



The 1986 amendments to the Job Training Partnership Act were suc- 
cessful in getting local programs to expand the use of remedial educa- 
tion in their programs. In 1987, the number of youth receiving 
remediation more than doubled from the previous year, and the funding 
for remediation increased by 73 percent. For 1988, the majority of ser- 
vice delivery areas planned to expand their remedial components even 
more. Local school districts were instrumental in planning the programs 
and were the primary providers of remediation. Most sdas were unable 
to serve all youth needing remedial education, in part because of trans- 
portation problems, inadequate funds, and lack of participant interest. 

Most program participants were assessed to determine their educational 
needs, according to local programs, which systematically evaluated par- 
ticipants after remediation to determine its impact on the youth. For 
most youth, reading and math scores improved, the programs reported. 
But the lack of uniform standards, goals, and assessments made it 
impossible for us to determine the program*s overall effectiveness. 

Before starting the 1987 program, sda officials anticipated that the 
remedial requirement would lead to reductions in numbers of youth to 
be served, hours of work available to the youth, and worksites. After 
the program was completed, many programs reported that these reduc- 
tions did occur, but fewer programs than originally envisioned had to 
make such cuts. 



dial education component of the program. Although Labor has provided 
technical assistance to local programs, it has not provided guidance or 
standards as to the amount of remediation or the population of youth to 
receive remediation. Matters such as these are local prerogatives and 
decisions, in the view of Labor officials. Any attempt by Labor to 
expand its role, they said, would be usurping local discretion provided 
under the law. Labor has no plans to evaluate the remedial component 
nor does it plan to establish guidelines on the amount of remediation or 
the number of youth who should receive it. 




Department of Labor's 
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Job Tlndning Partnership Act: Remedial 
EducaUon in the Summer Jobs Program 



SDAS reported they provided remediation to more youth and spent more 
of their title II-B funds in 1987 than in 1986. The reasons were that 
many sdas offered remediation for the first time in 1987, and those that 
had offered it in 1986 increased their emphasis on remediation. In 1986, 
57 percent of the sdas provided remediation, while in 1987 all sdas did. 
Of the SDAS that provided remediation in 1986, 68 percent increased the 
number of youth in remediation, and 69 percent increased the percent- 
age of their title II-B allocation spent on remediation. 

The number of youths that received remediation in 1987, 112,000, was 
more than twice the 55,000 in remediation in 1986, and represented 
about 20 percent of all youth in the summer program (compared with 8 
percent in 1986). The increase occurred even though the title II-B alloca- 
tion for the majority of sdas had been cut. More than 75 percent of the 
SDAS received less in title II-B funds for their 1987 program, they said, 
than for 1986. Eighty-four percent of the sdas served fewer youth in 
1987 than in 1986. The average amount of II-B funds spent on remedia- 
tion per youth declined from $773 in 1986 to $702 in 1987. 

The percentage of youth receiving remediation varied significantly 
?mong SDAS (see table 2.1). The majority >f sdas (70 percent) provided 
remediation to fewer than 30 percent of participants, while 13 percent 
provided remediation to more than half. One sda provided remediation 
to all participants because program officials assumed that all the youth 
would benefit from some aspect of an educational component. Another 
SDA provided remediation to 1 percent of its program participants. 



Table 2.1: Distribution of Program ■^■^■■^■^H 
Participants Receiving Remediation Percent of participants 

receiving remedLJon 



10 or less 


26 


11 to 20 


29 


21 to 30 


15 


31 to 40 


12 


41 to 50 


5 


More than 50 


13 



Remediation 
Expanded Greatly; 
Further Increases 
Planned 




Sixty-eight percent of the sdas reported that they did not provide 
remediation to all program participants that they thought needed it. 
Most of these sdas, which tended to be rural, said that transportation 
was a factor in their inability to do so. The refusal of youth to partici- 
pate and a lack of funds to pro\ ide remediation also were frequently 
cited (by 35 and 38 percent of sdas, respectively). 



ERIC 



Page 16 ^ GAO/HRI>88-118 Remedial Education in Sununer Jobs Program 



Chapter 2 

Job Training Partnership Act: Remedial 
Education in the Summer Jobs Program 



Table 2.2: Title ll-B Funds Spent by SDAs 
on Remediation 



In aggregate, the increase in the number of youth receiving remediation 
in 1987 conformed closely to sdas' expectations, sdas had planned to 
provide remediation to about 116,000 (21 percent) of the youth in the 
summer program. Their increases in funding also were anticipated: sdas 
spent $64 million on remediation in 1987, up from $37 million in 1986, 
thus increasing the percentage of their total II-B allocation from 5 to 12 
percent, sdas had planned to spend $67 million on remediation. Varia- 
tions among SDAS in remediation expenditures are shown in table 2.2. 



Percent of title II-B funds spent on remediation 


Percent of SDAs 


10 or less 


56 


11 to 20 


25 


21 to 30 


9 


31 to 40 


6 


41 to 50 


2 



h4ore than 50 



Many sdas (32 percent) supplemented their title II-B funding for the 
summer program from other sources. Fifteen percent of the sdas 
reported using some of their states' 8-percent set-aside funds,^ and one 
SDA funded its entire remedial education program with its title II-A 
funds. This allowed it to (1) meet a requirement that 40 percent of its 
II-A allocation be spent on youth and (2) provide work experience to 
more youth in the summer program. 

The amount of remediation also varied. Youth received an average of 90 
hours of remediation during the summer, ranging from 5 hours in one 
local program to 280 hours in another. Twenty-two percent of the sdas 
provided fewer than 45 hours of remediation. (Youth receiving remedial 
instruction are pictured in fig. 2.1.) 

SDAS planned to provide more remediation in their 1988 programs. Sixty- 
seven percent expect to provide remediation to more youth and 68 per- 
cent to spend a larger share of their total budgets. About 20 percent of 
the SDAS planned no change, while 5 percent would cut both the number 
of youth in remediation and the percentage of budget to be spent on it. 
In the remaining sdas, officials did not know what changes, if any, they 
would make. 



* Under JTPA, each state is required to use 8 percent of its title II-A allocation for education and 
training services to participants under title II. 
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Figure 2.1: Typical Remedlai Education Classroom 




Assessing Youths' 
Need for Remediation 



According to the jtpa amendments of 1986, sdas must assess the reading 
and mathematics skill levels of eligible participants and use program (or 
other) funds to provide basic and remedial education in accordance with 
their job training plans. The Department of Labor has informed sdas 
that they should assess the reading and math skills of all youth in the 
summer program, sdas reported that, on average, they assessed about 90 
percent of the youth in their 1987 programs. About 15 percent of sdas 
assessed fewer than 90 percent of the youth in their programs and 7 
percent, fewer than half. 
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SDAs have discretion in determining which youth receive remediation. 
Some SDAs limited remediation to youth who were of a specific age or 
resided in a certain geographic location and assessed only those youth 
who would be considered for remediation. For example, as one sda pro- 
vided remediation to only 14- and 15-year-olds, it did not assess the 
reading and math skills of youth over 15. Another sda, which served an 
eight-county area, planned to provide remediation to youth in only the 
two most populous counties because of the rural nature and related 
transportation problems of the other six counties. This sda assessed the 
educational needs of the youth in only the two counties in which it 
planned to provide remediation. 

Results of assessments were used by 86 percent of the sa^s to select the 
youth who would receive remediation. The various criteria used by sdas 
to determine which youth receive remediation and the prevalence of 
such use are shown in figure 2.2.^ 

About 9 percent of the sdas noted that they tried to get participants' 
grades from the school system for assessments, but the schools would 
not release the information. One sda, anticipating difficulty in this area, 
had the youths sign a request for the needed information from the 
school. This enabled the program to get the needed information and 
eliminated any conflict over confidentiality or access to school records. 

The nature of the assessments sdas used also varied. While some sdas 
conducted formal assessments or used school records, others used more 
informal means to select youth for remediation. For example, to deter- 
mine whether out-of-school youth needed remediation, one sda relied on 
a staff member's judgment of applicants' ability to fill out application 
forms and conduct themselves during interviews. 

Youth who received remedial education were very similar to all youth in 
the summer program. For example, in both the summer program and its 
remedial component, the percentage of males and females was about 
equal, and there was about an equal percentage of school drop-outs 
(about 5 percent). Also, 16 was the average age of the youth in the sum- 
mer program, as well as those in remediation. However, the educational 
component of the summer program served a greater percentage of youth 
under 16 than did the total summer program — 43 versus 32 percent. Of 
the youth participating in the summer program, 33 percent were from 
families receiving afdc, while 22 percent of those in remediation were 



''^See app. IV for the numerical values associated with this and other figures included in this report. 
Page 18 GA0/HRD^118 Remedial Education in Summer Jobs Program 



Chapter 2 

Job Training Partnership Act: Remedial 
Education in the Summer Jobs Program 



Figure 2.2: Criteria Used in Selecting ^^HHHHM 
Youth for Remediation 
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90 
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# ^^"^ 

Critorla Used 

from such families. Characteristics of these populations appear in 
figures 2.3 and 2.4. 



As forecasted, the sdas used schools as primary remedial education 
providers. Nearly three-fourths of the sdas indicated that local school 
districts provided at least some remedial education services, and nearly 
half of the sdas said that they used them as the primary providers. 
Organizations cited as providing some remediation are shown in figure 
2.5, and the primary providers of remedial education services in figure 
2.6. 

One SDA contracted with a Job Corps center in its service area to provide 
remediation. This was done primarily because the center had an educa- 
tion system in place, it was accessible, and theSDA wanted to join 
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Figure 2.3: Age of Summer Program and 
Remedial Education Participants 
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Figure 2.4: School Status of Summer 
Program and Remedial Education 
Participants 
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Figure 2.5: Organizations Cited as 
Providing Remediation 



100 PorcGOtofSDAs 
90 




Remedial Education ProvidGrs 



Figure 2.6: Organizations Cited as 
Primary Providers of Remediation 

(Percentage of SDAs) 
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another federal program with a similar mission in operating a pilot pro- 
gram. Another SDA used the local school district's existing summer 
school program to provide remediation. Participants attended summer 
school classes with nonprogram youth. 



Incentives Provided to 
Youth in Remediation 



Because youth prefer work experience to remedial education, most pro- 
grams provided incentives for participation in remediation, such as: 

60 percent provided wages (on average, $3.35 per hour), 

26 percent paid stipends (on average, $42.00 per week), 

55 percent arranged for youth to get high school credit, and 

46 percent required that youth participate in remediation to get a job. 

In one case, an sda that did not provide wages awarded points based on 
academic performance to program participants. The points could be 
used to obtain such items as gift certificates at restaurants of the 
youth's choice, paperback books, watches, cameras, sporting equipment, 
and clock radios. 



Various Teaching 

Approaches 

Employed 



SDAs used a variety of approaches in delivering remediation: 

94 percent taught youth in group settings (see fig. 2.7, which shows 

instruction in a group setting); 

77 percent taught youth individually; and 

69 percent used both lecture and an individually paced approach. 

How the SDAS characterized the content of their remedial programs is 
shown in figure 2.8. 

About oxie-fourth (24 percent) of the Sdas provided some remediation at 
the worksites. In one SDA, youth were given a summer job to tutor other 
youth at their worksites. 

Many sdas (aoout 70 percent) used computers as a tool in providing 
remediation — ihe same proportion that did so in 1986. On average, the 
SDAS reported that 53 percent of those in remediation used computers an 
average of 7 hours per week. One Sda conducted most of its remedial 
program with con^puters, each youth spending 2 hours per week for 6 
weeks in computer learning. (Use of computers in remediation is 
depicted in fig. 2.9,) 
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Figure 2 J: Classroom Remedial Education Instruction 




On average, SDas maintained a student-teacher ratio of about 18 to 1, 
they said. In addition, sa^s used teachers* aides, making the average 
ratio of students to total staff, including teachers and aides, 14 to 1. 

During the summer of 1987, sms provided about 90 hours of remedia- 
tion per participant— 13 hours in each of 7 weeks. The amount of 
remediation varied significantly amongst the SDas and ranged from 5 to 
280 hours during the summer program (see fig. 2 JO). 
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Figure 2.8: Type of Remediation 
Provided 
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Most SDAS (86 percent) reported that they systematically evaluated the 
impact of remedial education on youth o,nd found that the majority of 
youth benefited from participation. Of SDas that did such evaluations, 92 
percent used pre- and post-program tests. Seventy-nine p cert of the 
SDAS said that the majority of the youth iraproved their reading abilities 
and 76 percent that most youths' math test scores improved. Because of 
the differences in testing approaches, we were unable to determine the 
extent of gain from the SDas in our sample. 

The effectiveness of the remedial component cannot be readily deter- 
mined. In the absence of federal standards or goals, SDas set their own 
goals for the remedial component of their programs. These goals are 
sometimes unmeasurable or difficult to attribute to the program. For 
example, the goals established by one SDA included improved behavior, a 
more positive attitude, and improved attendance upon returning to 
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Figure 2.9: Introducing Remedial Education Students to Computer Use 




school. Another sda set a program goal of deterring youth from dropping 
out by providing financial and psychological support. Also, sdas that 
had quantifiable goals and tried to measure results used a variety of 
tests. 

Nearly two out of five sdas (39 percent) followed up on the youth after 
they completed the remediation component of the program (see fig. 
2.11). Thirty-seven percent of the sdas determined whether youth 
returned to school, and 23 percent sought to determine whether those in 
remediation were able to obtain a job. 
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Figure 2.10: Extent of Remediation and ^^^^^■■HHH 

Work Provided 
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Many sda officials expected the 1986 remediation requirement to neces- 
sitate reductions in other aspects of their 1987 summer youth program. 
When contacted after completion of the 1987 program, a significant 
number of sdas reported making these reductions. But the number was 
somewhat less than the number that indicated they planned to make 
these reductions. 

In March 1987, the sda officials said that as a result of the remediation 
requirement they expected to have to make certain cuts. These included 
reductions in the number of (1) hours of service provided to the commu- 
nity or employers, (2) worksites at which youth would be given work 
experience, and (3) youth who would participate in the summer work 
program. The percentage of sdas that planned and actually made these 
program changes is shown in table 2.3. 
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Figure 2.11: Folio w-Up by SDAs on Youth 
V/ho Received Remediation 
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Table 2.3: Anticipated and Actual 
Reductions in SYETP Resulting Fronnj 
Remediation Requirement 





Percent of SDAs 


Reductions in 


Changes 
planned 


Actual 
changes 


Hours of work experience 


76 


63 


Number of worksites 


52 


.40 


Number of program participants 


49 


45 



Although many SDAs noted making these changes, the majority 
expressed the belief that the remedial education requirement improved 
the overall program (see fig. 2.12). In addition, some SDAs noted that 
they made reductions in other aspects of their programs, but this was 
due to funding reductions rather than the remediation requirement. 
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Figure 2.12: Effect of Education 
Requirements as Reported by SDAs 
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Additional Insights 
From Nine Local 
Programs Visited 

• Programs in areas of low unemployment had difficulty attracting 
participants. 

• Three programs provided remediation to all youth without respect to 
need. 

• The amount of remediation provided varied greatly. 

• Where post-program testing was done, large improvements were 
reported. 

• SDAS with prior remediation programs experienced fewer problems. 

One program thac served an area with low unemployment rates expe- 
rienced recruiting problems. During the summer of 1987, when the 
national unemployment rate was 6.0 percent, the sda had an unemploy- 
ment rate of 3.7 percent. This sda emphasized recruitment of 14- and 15- 
year-olds for the program and the remedial education component. It 
planned to deal with its recruiting problem by increasing its payment to 



The nine sdas we visited to better understand implementation of the 
mandatory remediation component were neither randomly selected nor 
large enough in number for us to project their activities to all sdas. How- 
ever, the visits did provide some additional insights. 
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youth as well as recruiting more 14- and 15-year-olds, who were too 
young to work at higher paying jobs. While the program paid its youth 
$3.37 per hour, a program official noted, a local fast food restaurant 
paid up to $5. 

Some programs, because of their procedures in selecting youth for 
remediation, expanded education services to all youth without consider- 
ation of need. Three sdas provided education to youth without first 
identifying youth with academic deficiencies. In two sdas, this was done 
because of problems in obtaining school records. The third sda provided 
remediation to all youth, noting that all participants would benefit from 
remediation. 

The nature and duration of training varied considerably across sdas. 
While most sdas' remedial programs included reading and math, several 
added other components. One sda devoted substantial efforts to develop- 
ing participants' writing skills. Another offered a Job (Dorps-developed 
course, entitled World of Work, designed to enhance participants' 
employability skills. One sda provided remediation to youth by having 
them tutor children in kindergarten through sixth grade. Two sdas pro- 
vided remediation solely through computerized training, while another 
contracted with the school system and gave youth stipends to take 
courses required by the school district in summer school. 

Also, the extent of remediation varied considerably. Two sdas offered 12 
hours of remediation (computer-assisted only), while another program 
provided 42 hours of remediation. 

Consistent with our survey data, the effectiveness of the remedial com- 
ponent at SDAS we visited was sometimes unknown. At two sdas, none of 
the youths who received remediation were post-tested, while another 
tested about half of the youth before and after remediation. Where pre- 
and post-program testing was used, the results varied. For example, one 
sda reported average reading gains of 2.4 grades (ranging from 0.6 to 6.0 
grade levels), while another sda reported a gain of about 1 grade. 

SDAS that provided remediation prior to 1987 appeared to have less diffi- 
culty with their remedial component than did sdas providing it for the 
first time. For example, an sda that offered remediation before 1987 
assessed all youth to determine their educational needs, provided 
remediation to those in need, used pre- and post-program testing to mea- 
sure success, and planned no substantial changes in 1988. Another sda, 
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offering remediation for the first time, was unclear as to how the reme- 
dial component should be designed and had difficulties providing 
remediation to all its youth. It had little information on the success of 
the educational component because of difficulties in post-program test- 
ing, and planned major changes in its 1988 summer program. 



PonrlllSlOnS '^^^ ^^^^ responded in varying degrees to the requirements of the 

v^UllClUoiUilb j^p^ amendments that money be spent on remedial education for sum- 

mer program participants who are academically deficient. In 1987, 
many sdas initiated a remediation program for the first time, while 
others that offered remediation prior to the requirement increased the 
amount of remediation they provided. Also, the majority of sdas planned 
to further increase the number of youth to whom remediation is pro- 
vided and the proportion of their budget to be spent on remediation in 
1988. However, uncertainty persists over the effectiveness of the reme- 
dial component, the number of youth who should be receiving remedial 
education, and the amount of remedial education that should be 
provided. 

Many localities have sought to measure the effectiveness of the remedia- 
tion provided. Local programs have used several different testing 
instruments to obtain information needed for management decisions 
related to their programs. Most sdas reported that the majority of the 
youth participating in the remedial education component experienced 
gains in reading and math. Because of the variations in program goals 
and testing approaches, however, it is not possible to determine the 
overall effectiveness of this program. Also, some of the gains reported 
by sdas appear to be questionable, as in the case of one sda reporting a 
reading gain of six grades during the summer. 

Certain national-level program information is unavailable and not rou- 
tinely collected. This is information that would allow measurement of 
the effectiveness of the program or assist the Ck)ngress and the Depart- 
ment of Labor in identifying areas that may need legislative or regula- 
tory change. Because the majority of sdas currently perform some type 
of testing, it would seem reasonable to expect programs to evaluate the 
effectiveness of their remedial components without disruption to the 
programs. 

Many youth identified by local programs as needing remedial education 
are not getting it. The current legislation prescribes no minimal number 
or percent of youth to receive remediation. The Congress did, however, 
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require that sdas assess the educational skills of eligible program partici- 
pants to determine those needing remediation. Most sdas assessed the 
educational needs of the youth, but nearly 70 percent reported they 
were unable to serve all youth they identified as needing remediation. 
The number of youth receiving remediation varied greatly among sdas, 
with more than one-quarter providing remediation to less than 10 per- 
cent of program participants and about 10 percent of the programs pro- 
viding remediation to more than half of the participants. 

The amount of remediation provided in the program varied considera- 
bly, with some sdas providing very little. Nearly one-quarter of the pro- 
grams provided fewer than 45 hours during the entire summer. With 
programs offering such a limited amount of remediation, the benefit to 
youth from the program appears questionable. The Department of Labor 
has issued no requirements or guidance on the amount of remediation 
that SDAS should provide. However, the Job Corps program, which 
shares in the mission to enhance the academic skills of economically dis- 
advantaged youth, provides youth with 20 hours of remediation per 
week. This is more than the average of 13 hours per week offered in the 
summer program and considerably more than that offered by those pro- 
grams that offered only a few hours per week. 



Matters for 
Consideration by the 
Congress 



Although most local program administrators believe the remediation 
component of the summer youth program has been successful, the com- 
ponent's overall effectiveness is unknown. The Congress may, therefore, 
wish to consider requiring Labor to evaluate all or a sample of these 
programs' remediation components using standardized educational 
achievement tests. 



And, although nearly all sdas have added remediation to their programs, 
the proportion of youth receiving services varies greatly. Thus, the Con- 
gress may also wish to consider requiring that 

• the Department of Labor define some minimal amount of remediation 
that must be provided during the summer and 

• all youth in the program who are in need of remedial education receive 
such remediation. 
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Service deliverv area 


State 


Name 


Location 


Alabama 


Mobile Consortium 


Mobile 


Arkansas 


North Central 


Batesville 




Northwest 


Harrison 




Little Rock 


Little Rock 




Southwest 


Magnolia 


Arizona 


Cochise County 


Bisbae 




Coconino County 


Flagstaff 




Apache County 


Flagstaff 




Gila-Pinal Consortium 


Florence 




Navaho County 


Holbrook 




Mohave-LaPaz Consortium 


Parker 




Maricopa County 


Phoenix 




Phoenix 


Phoenix 




Pima County 


Tucson 


California 


Golden Sierra Consortium 


Aijburn 




Kern, Inyo, Mono Consortium 


3akersfield 




Nortec Consortium 


Paradise 




Humboldt County 


Eureka 




Solano County 


Fairfield 




Fresno Consortium 


Fresno 




San Benito County 


Hollister 




Merced County 


Merced 




City of Oakland 


Oakland 




San Bernardino County 


San Bernardino 




Sonoma County 


OCllllCl ilUoCl 




Mother Lode Consortium 


Sonora 




Carson, Lomita, Torrance Consortium 


Torrance 




Mendocino County 


Uklah 




Yolo County 


Woodland 


Colorado 


Boulder County 


Boulder 




City of County of Denver 


Denver 




Rural 


Denver 




Weld County 


Greeley 


Connecticut 


Meriden-Mlddletown 


Merlden 




Northeast: Danlelson-Wllllmantic 


North Windham 


DC 


Single State SDA 


Washington 


Delaware 


Single State SDA 


Newark 
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Service delivery area 



State 


Name 


Location 


Florida 


Heartland 


Lakeland 


Lee County 


Ft. Myers 


North Central 


Gainsville 


Northeast 


Jacksonville 


Brevard County 


Merritt Island 


Charlotee, Collier, Glades, Hendry 


Naples 


Withlacoochiee 


Ocala 


Northwest/Escambia County 


Pensacola 


Gadsden, Jefferson, Leon Counties 


Tallahassee 


City of Tampa 


Tampa 


Flagler. Lake, Volusia Counties 


Tavares 


Georgia 


Northeast Georgia 


Athens 


Metropolitan Atlanta 


Atlanta 


West Central Georgia 


Griffin 


Hawaii 


County of Hawaii 


Hilo 


Idaho 


Clearwater 


Moscow 


Southeast 


Pocatello 


Illinois 


St. Clair County 


Belleville 


Champaign Consortium 


Champaign 


Macon and Dewitt Counties 


Decatur 


South Central SDA 


Greenup 


Will County 


Joliet 


LaSalle County 


Ottawa 


Tazewell County SDA 


Pekin 


Land of Lincoln Consortiurr 


Springfield 


Indiana 


Hoosier Falls 


Jeffersonville 


Southeastern Indiana 


Madison 


East Central 


Portland 


Iowa 


SDA 10 


uouncil dIutts 


SDA1 


Postville 


SDA 4 


Sioux City 


SDA 7 


Waterloo 


Kansas 


SDA 111 


Kansas City 


Kentucky 


Northern Kentucky 


Florence 


Eastern Kentucky 


Hazard 


Bluegrass Area 


Lexington 


City of Louisville/Jefferson County 


Louisville 


North Central Kentucky 


Louisville 


Northeast Kentucky (TEN-CO) 


Maysville 


The Cumberlands 


Russell Springs 
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Service deiivery area 



State 


Name 


Location 


Louisiana 


East Baton Rouge Parish 


Baton Rouge 




St. Charles Parish Consortium 


Hahnville 




Sixth Planning District Consortium 


Jena 


Maine 


Cumberland County 


Portland 


Maryland 


Susquehanna Region 


Havre de Grace 




Southern Maryland 


La Plata 




Montgomery County 


Rockville 




Prince George*s County 


Seat Pleasant 




Lower Shore 


Snow Hill 


Massachusetts 


Boston 


Boston 




City of Brockton 


Brockton 




Northern Worcester 


Gardner 




Franklin and Hampshire Counties 


Greenfield 




Northern Middlesex County 


Lowell 




Metro South/\''est 


Norwood 




Hampden County 


Springfield 




Southern Worcester 


Worcester 


Michigan 


Lake, Mason, Mecosta, Newaygo, etc. 


Big Rapids 




Central Upper Peninsula - Six County 


Escanaba 




Genessee and Shiawassee Counties 


Flint 




Hillside, Jackson, Lenawee Counties 


Jackson 




Huron, Lapeer, Sanilac, Tuscola 


Marlette 




Muskegon and Oceana Counties 


Muskegon 




Greater Pontiac 


Pontiac 




Northwest Lower Michigan 


Traverse City 


Minnesota 


Rural Minnesota CEP, Inc. SDA #2 


Detroit Lakes 




City of Duluth SDA #4 


Duluth 




South Central SDA #7 


Mankato 




City of St. Paul SDA #11 


St. Paul 




Northeast: SDA #3 


Virginia 


Mississippi 


Gulf Coast Business Services Corp. 


Gulfport 


Missouri 


SDA 13: St. Louis Countv 


Clayton 




SDA 5 


Fulton 




SDA 15 


Hillsboro 




SDA 4 


Sedalia 




SDA 8 


Springfield 


Montana 


Concentrated Employment Program Area 


Helena 




Balance of State 


Helena 
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Service delivery area 



State 


Name 


Location 


Nebraska 


Greater Lincoln 


Lincoln 




Greater Nebraska 


Lincoln 




Greater Omaha 


Omaha 


New Hampshire 


Hillsborough County 


Concord 


New Jersey 


Gloucester County 


Deptford 


New Mexico 


Albuquerque/Bernalillo County 


Albuquerque 


New York 


Ontario/Seneca/Wayne/Yates Counties 


Canandaigua 




St. Lawrence County 


Canton 




Cayuga/Cortland/Tompklns Counties 


Cortland 




Oswego County 


Fulton 




Genessee/Llvlngston/Orleans/Wyoming 
Counties 


Genesee 




Chenango/Delaware/Otsego Counties 


Hamden 




Columbia/Greene Counties 


Hudson 




Sullivan County 


Monticello 




New York CItv 


Npw York 




nilntnn/F<!<!py/Franklin/Wflnniltnn Clm intiPQ 

will 1 lUI 1/ 1— OOCA/ 1 IClllfMIII/l lOllllllUII WUUIIIICO 


Plfltt^hi irnh 

1 lOllOUUi ^1 1 




uoiciiiuc \j% iviuiiluc wuuiiiy 


Rnphpctpr 




Jpffpr«!nn/I pwi«; nniintiPQ 


\A/j^ t p r t n\A/ n 

VVOlCi lUWI 1 


Nnrth narnlina 


nitv nf nhflrlnttp/Mprklpnhiirn nniintv 


Phflrlnttp 




Hpntral PipHmnnt Fmnlnvmpnt anH Trainlnn 


niirhfim 

ki^Ui i lOI 1 1 




Wakp and Jnhn«!{nn nniintip<! 

vvcirxw ui wi II iwivi 1 Vi/wUiiiicw 


Ralelnh 

1 Iwll 1 1 


Ohio 


Citv of Cincinnati" SDA 8 

Vi/liy VI Vi/ll IWll II ion* WL<^f \ w 


r^inplnn^tl 

wll lUll II lull 




Franklin nniintv SHA Ifi 
1 iciiiiMiii wuuiiiy. \jLJr\ i\j 


wUIUlllUUo 




Butler Countv SDA 6 


Hamilton 

1 lai i III i^^i 1 




Morrow /Ashland/Richland/Knox Counties' 
SDA 14 


Man<;fiplH 

IVIOI IdllCIU 




Columbiana and Mahoning Counties: SDA 
30 


Youngstown 


Oklahoma 


Northwest 


Beaver 




Southwest 


Burns Flat 




Southern 


Durant 




Central 


Oklahoma City 




East Central 


Shawnee 




Tulsa City/Tulsa/Creek/Osage Counties 


Tulsa 


Pennsylvania 


Lehigh and Northampton Counties 


Allentown 




Armstrong, Butler, Indiana Counties 


Butler 




Adams and Franklin Counties 


Chambersburg 




Bucks County 


Doylestown 




Beaver County 


New Brighton 



(continued) 
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Service Delivery Areas Surveyed by GAO 



Service delivery area 



State 


Name 


Location 






City of Pittsburgh 


Pittsburgh 






Berks County 


Reading 






Six Counties (Sixco) 


Ridgway 






Northern Tier (Bradford/Sullivan, etc.) 


Towanda 




Rhode Island 


Balance of State 


Providence 




South Carolina 


Single Statewide 


Columbia 




Tennessee 


SDA#7 


Algood 






SDA#5 


Cleveland 






SDA#13 


Dyersburg 






SDA#14 


Memphis 






SDA#8 


Nashville 




Texas 


Panhandle 


Amarillo 






Rural Coastal Bend 


Beeville 






Central Texas 


Belton 






Cameron County 


Brownsville 






Middle Rio Grande 


Carrizo Springs 






Balance of Dallas County 


Dallas 






Texoma 


Denison 






Hidalgo/Willacy Counties 


Edinburg 






Upper Rio Grande 


El Paso 






Fort Worth Consortium 


Forth Worth 






Balance of Harris County 


Houston 






Balance of Gulf Coast 


Houston 






East Texas 


Kllgore 






ooiiih Texas 


Laredo 






Permian Basin 


Midland 






Uavis L/Ouniy 


Farming ton 






Central (Six County) 


Richfield 






Uintah Basin 


Roosevelt 






Salt Lake and Tooele Counties 


Salt Lake City 




Virginia 


New River/Mount Rogers Employment and 
Training 


Abingdon 






Alexandria/Arlington Job Training 
Consortium 


Arlington 






Northern Virginia Manpower Consortium 


Fairfax 






ONE Inc. 


Lebanon 






Bay Area Job Training Consortium 


Warsaw 




V\^shington 


The Pacific Mountain Consortium: SDA2 


Olympia 






Olympic Consortium: SDA 1 


Port Orchard 






The Seattle-King County PIC: SDA 5 


Seattle 





(continued) 
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Service delivery area 



State 


Name 


Location 




The Pentad: SDA8 


Wenatchee 




Tri-Valley Consortium SDA 9 


Yakima 


West Virginia 


Balance of State 


Charleston 


Wisconsin 


Northwest Wisconsin: SDA 9 


Ashland 




Western Wisconsin: SDA 16 


LaCrosse 




Nort^ Central Wisconsin: SDA 13 


Madison 




West Central Wisconsin: SDA 1 1 


Menomonie 




Southwestern Wisconsin: SDA 15 


Monroe 




WOW Job Training Partnership: SDA 12 


Waukesi;a 




Central Wisconsin: SDA 10 


Wisconsin Rapids 
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Technical Description of GAO's Survey and 
Sampling Methodology 



This appendix contains a technical description of our interview survey 
design, pretesting of the interview survey, selection of the sample, and 
calculations of sample errors. 



During December 1987 and January and February 1988, GAG adminis- 
tered a standardized telephone interview using the computer-aided tele- 
phone interview technique to a random sample of 200 local programs — 
service delivery areas. This random sample was the same as the first 
sample of sdas included in our June 1987 report. We spoke to the same 
program officials whom we contacted during our previous effort. These 
officials had been designated by the sda directors as the most knowl- 
edgeable about their remedial education efforts in th-jir particular 
program. 

The interview survey was designed primarily to obtain facts about how 
and to what extent remedial education was provided in their 1987 pro- 
gram. We also asked several questions that called for opinions, such as 
why certain actions were taken and how important these actions were. 

The survey instrument was pretested with five of the summer youth 
programs in our random sample. Trained gag staff administered the 
questionnaire to the program administrators over the telephone. We 
noted any difficulties the respondent had in answering questions and 
made changes accordingly. 



Prior to selecting a random sample, we identified a universe of 568 sdas 
that served the same geographic area in 1987 that they served in 1986. 
We also wanted to determine whether sdas with different population 
density may have implemented the remeaial education requirement dif- 
ferently. To test for these differences, we stratified our random sample 
into urban, suburban, and rural sdas, based on 1980 census data. Table 
II. 1 shows how our sample was stratified: 



Table 11.1: GAO Sample Stratification 



Population density 


Universe 


Sample 


No. of 


size 


size respondents 


Urban 


278 


33 


83 


Suburban 


233 


79 


79 


Rural 


57 


38 


38 


Totals 


568 


200 


200 



40 



Interviev/ Survey 
Design 



Sampling SDAs 
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Technical Description of GAO*s Survey and 
Sampling Methodology 



SdlUDlill^ Errors projected our survey results from a sample to the universe of all 

^ ^ SDAs. Each projection, however, has a sampling error associated with it. 

A sampling error is the most an estimate can be expected to differ from 
the actual universe characteristics. 



Sampling errors usually are stated at a specific confidence level, 95 per- 
cent in this case. This means that the chances are 95 out of 100 that, if 
we surveyed all the Sdas, the results would differ from the estimates we 
have made by less than the sampling error of that estimate. 

For this survey, the sampling error for each estimate does not exceed 
plus or minus 5.6 percent for any categorical question and plus or minus 
9.1 percent for any question stratified by population density. An exam- 
ple of the sample errors for one of the questions we asked is presented 
in table II.2. 



Table 11.2: Sample Error Estimate for 
Categorical Question (l-iov/ Many SDAs 
Provided Remediation Prior to 1987?) 



Figures are percents 


Population density 


SDAs that provided 
remedial education 
before 1987 


Sample 
error 


Urban 


66 


±8.5 


Suburban 


48 


±9.0 


Rural 


40 


±9.1 


Total 


56 


±5.6 



The sample error estimates for questions that have a continuous range 
of answers, such as the average number of participants, vary widely. 
Table II.3 lists the average answer for several key questions and sample 
error (at the 95-percent confidence level) associated with it. 
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Technical Description of GAO's Survey and 
Sampling Metiiodology 



Table 11.3: Sample Error Estimate for 
Continuous Questions (Program Costs and 
Partclpation) 





1986 




1987 






Estimate Sample error 


Estimate Sample error 


Total SYETP: 


Total cost 


$710 


±$160 


$523 


±$57 


Average cost per SDA 


$1.3 


±$0.3 


$.93 


±$.10 


Total participants 


671,000 


±214.000 


559,000 


±174.000 


Average participation 


1,190 


±380 


980 


±310 


Average cost per youth 


$1,233 


±$36 


$1,280 


±$44 


Remedial education in SYETP: 


Total cost 


$37 


±$10 


$64 


±$12 


Average cost per SDA 


$118,000 


±$31,000 


$123,000 


±$23,000 


Total participants 


55.000 


±14.000 


112,000 


±21.000 


Average participation 


170 


±44 200 


±40 





Average co?* per youth 



$755 



±$110 



$700 



±$80 



Verifying Responses Questions that asked for substantive data, such as the number of par- 

ticipants, demographic characteristics, and cost data, were checked for 
consistency with each other. Some of the answers were also compared to 
those given to related questions in our previous review for consistency. 
Also, we visited nine sdas where we observed the program operations. 
The information obtained at these sdas was compared to that received 
from the telephone interviews. Also, certain information on the number 
of youth in the summer program and remediation, as well as the demo- 
graphic characteristics of these, was obtained from the state data base. 
Any discrepancies from these comparisons or figures that were out of an 
expected range were reconciled by furth^ t discussions with program or 
state officials. Our program-wide estimates were consistent with data 
avai'-^ble at the Department of Labor. 
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^Semedial Education Provided by Nine SDAs 
Visited by GAO: Summaries 



We visited nine service delivery areas to obtain a more complete picture 
of how remedial education was provided in their 1987 Sununer Youth 
Employment and Training Program. These sdas were judgmentally 
selected after we considered several factors. Among these were geo- 
graphic location, whether they had pro\aded remediation prior to 1987, 
the number and type of entities providing remediation, the number of 
participants in the summer program and in remediation, the method of 
instruction used, the urban/rural mix of the population to be served, 
program funding levels, and estimated funding levels for remediation. 

We conducted structured interviews with the officials responsible for 
administering the summer youth c^mployment program, representatives 
of the private industry councils, en^ployers of youth in remediation, 
instructors in the remedial program, and participating youth. The infor- 
mation contained in the following summaries is based primarily on these 
interviews. Characteristics of the nine sdas are charted in table IILl. We 
also obsei-ved remedial education classes and worksites, and obtained 
statistics on the number of program participants and their demographic 
characteristics (see table III.2) at boi:h the sda and state level. 

The efforts of the nine sdas to provide remediation as part of their SfKTP 
are described in this appendix. 
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Remedial Education Provided by Nine SDAs 
Visited by GAO: Summaries 



Table IIL1: Profiles of SDAs Visited by 
GAO 



SDA charactenstics 


Flagstaff, 
AZ 


Harrison, 
AR 


Area served 


1 

county 


9 

countieo 


Area population 


70.000 


350.912 


1987 summer unemployment rate 
(percent) 


9.4 


4.0 


Provided remedial education in 1986 


No 


Yes 


No. of youth served in 1987 


99 


655 


No. of youth receiving remedial 
education 


92 


150 


Percent of youth served 


(92.9) 


(22.9) 


Total SYETP funding allocation 


$205,000 


$569,000 


Total remedial education cost 


$79,000 


$224,000 


Percent of total allocation 


(38.5) 


(39.4) 


No. of remedial education providers 


2 


1 


Type of remedial edMcation providers 


SDA and 
vocati'^nal 
training inst. 


SDA 
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Remedial Education Provided hy Nine SDAs 
Visited by GAO: Summaries 





Bakersfield, 
CA 


North Windham, 
CT 


Fort Myers, 
FL 


Ottawa, 
IL 


Pittsburgh, 
PA 


Carrizo Springs, 
TX 


Farmington, 
UT 


3 

counties 


18 

towns 


1 

county 


4 

counties 


City of 
Pittsburgh 


9 

counties 


1 

county 


487.000 


125.000 


241.000 


181.000 


390.000 


144.000 


175.000 


9.3 


3.7 


4.0 


9.7 


6.6 


16.6 


5.4 


Yes 


Yes 


No 


Yes 


No 


No 


Yes 


1.743 


315 


312 


388 


1.835 


815 


100 


859 


28 


86 


84 


243 


815 


49 


(49.3) 


(6.9) 


(27.6) 


(21.6) 


(13.2) 


(100.0) 


(49.0) 


$1,900,000 


$378,000 


$292,790 


$555,000 


$1,759,000 


$904,513 


$152,000 


S21 9.000 


$91,000 


$50,000 


$32,479 


$13,964 


$159,087 


$59,500 


(11.5) 


(24.1) 


(17.1) 


(5.9) 


(0.8) 


(17.6) 


(39.1) 


13 


2 


1 


5 


1 


1 


1 


8 school districts, 
3 colleges, 2 
county agencies 


Community-based 
organization 


School district 


SDA. 2 school 
districts. 2 
community 
colleges 


School district 


SDA 


Job Corps 
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Remedial Education Provided by Nine SDAs 
Visited by GAO: Summaries 



Table III.2: Participant Demographic 
Profiles of SDAs Visited by GAO 



Participant characteristic 


Flagstaff, 
AZ 


Harrison, 
AR 


Total served 


99 


655 


Age and sex: 


Average age 


17.3 


15.2 


Total male 
(% of tota!) 


48 
(48.5) 


342 
(52.2) 


Tota! female ' 
(% of tota!) 


51 
(51.5) 


313 
(47.8) 


School status: 


Elementary/secondary school student— no. 
(% of total) 


75 
(75.9) 


658 
(97.4) 


High school graduate or GED— no. 
(% of tota!) 


13 
(13.1) 


14 
(2.1) 


Postsecondary school student— no. 
(% of total) 


4 

(4.0) 


0 


School dropout— no. 
(% of total) 


7 

(7.1) 


3 

(0.3) 


Ethnicity: 


White (non-Hispanic)— no. 
(% of total) 


31 
(31.3) 


641 
(97.9) 


Black (non*Hispanic)— no. 
(% of total) 


8 

(8.1) 


10 
(1.5) 


Hispanic— no. 
(% of total) 


15 
(15.2) 


3 

(0.5) 


American Indian— no. 
(% of total) 


45 
(45.5) 


1 

(0.2) 


Asian— no. 
(% of total) 


0 


0 


Filipino/other— no. 
(% of total) 


0 


0 


Receiving public assistance— no. 

(% of total) 


8 

(8.1) 


62 
(9.5). 


Type of assistance: 


AFDC 


a 


62' 


General 


a 


0 


Refugee 


a 


0 


SSI 


a 


0 


Food stamps 


a 


0 


Other 


a 


0 



^Three states— Utah, Arizona, and Florida— indicated whether participants received assistance but not 
the type of assistance provided. Pennsylvania did not indicate the type of assistance for all participants 
receiving assistance. 
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Remedial E. 
Visited by G.^ 



.don Provided by Nine SDAs 
.Summaries 





Bakersfield, 
CA 


North 
Windham, 
CT 


Fort Myers, 
FL 


Ottawa, 
iL 


Pittsburgh, 
PA 


Carrizo 
Springs, TX 


Farmington, 
UT 


1,743 


315 


312 


388 


1,835 


815 


100 




16.0 


15.3 


15.5 


16.9 


17.3 


15.7 


16.6 


918 
(52.7) 


175 
(55.6) 


135 
(43.3) 


223 
(57.5) 


844 
(46.0) 


407 
(49.9) 


55 
(55.0) 


825 
(47.3) 


140 
(44.4) 


177 
(56.7) 


165 
(42.5) 


991 
(54.0) 


408 
(50.1) 


45 
(45.0) 




1.621 
(93.0) 


306 
(97.1) 


276 
(88.5) 


301 
(77.6) 


1.125 
(61.2) 


788 
(96.7) 


32 
(82.0) 


43 
(2.5) 


2 

(0.6) 


8 

(2.6) 


41 
(10.6; 


433 
(23.6) 


27 
(3.3) 


10 
(10.0) 


28 
(1.6) 


2 

(0.6) 


6 

(1.9) 


22 
(5.7) 


146 
(8.0) 


0 


0 


51 
(2.9) 


5 

(1.6) 


22 
(7.1) 


24 
(6.2) 


133 
(7.2) 


0 


8 

(8.0) 




506 
(29.0) 


232 
(73.7) 


30 
(9.6) 


345 
(89.9) 


179 
(9.8) 


19 
(2.3) 


73 
(73.0) 


438 
(25.1) 


5 

(1.6) 


233 
(74.7) 


19 
(4.9) 


1.645 
(89.6) 


5 

(0.6) 


1 

(1.0) 


704 
(40.4) 


71 
(22.3) 


49 
(15.7) 


12 
(3.1) 


8 

(0.4) 


791 
(97.1) 


17 
(17.0) 


35 
(2.0) 


4 

(1.3) 


0 


1 

(0.3) 


2 

(0.1) 


0 


0 


55 
(3.2) 


3 

(1.0) 


0 


11 
(2.3) 


1 

(0.1) 


0 


9 

(9.0) 


5 

(0.3) 


0 


0 


0 


0 


0 


0 


738 
(42.3) 


144 
(45.7) 


259 
(83.0) 


103 
(26.5) 


1.246 
(67.9) 


626 
(76.8) 


16 
(16.0) 




533 


125 


a 


89 


1.185 


187 


a 


0 


10 


a 


3 


59 


0 


a 


0 


0 


a 


0 


a 


0 


a 


43 


9 


a 


17 


a 


53 


a 


513 


0 


a 


0 


a 


621 


a 


2 


0 


a 


71 


a 


0 


a 
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Remedial Education Provided by Mne SDAs 
Visited by GAO: Summaries 



Flagstaff, Arizona 



Profile: 


1987SYETP 


Administrative entity: 


Coconino Career and Training Center 


Geographic area served: 


Coconino County 


Summer unemployment rate: 


9.4 percent 


Funding level: 


$205,000 


Number served: 


99 


1987 Remedial Component 


Had prior remediation: 


No 


Provider: 


Coconino Career and Training Center; 




vocational training institute 


Assessment tools: 


Standardized test 


Cost: 


$79,000 


Number served: 


92 


Average hours per person: 


64 


Youth paid to attend: 


Yes -$3.35 per hour 


Evaluation: 


No formal process 



The Coconino Career and Training Center in Flagstaff administers jtpa 
programs for Coconino County in northern Arizona. Coconino County, 
classified by the state as rural, has a population of about 70,000 and an 
unemployment rate of about 11 percent, according to the Center's staff. 

The Center added a remedial education component to its summer pro- 
gram in response to the jtpa amendments, the Center Program Adminis- 
trator told us. The objective of the summer program was to motivate 
youths to maintain academic standards through the summer by using a 
nontraditional classroom approach in addition to pro viding work experi- 
ence. The summer program's goals, as outlined in the Center's operating 
plan, included having the youths 

• maintain their end-of-academic-year performance in reading and math, 

• maintain their motivation to complete school, 

• develop employability and basic living skills, and 

• develop writing skills that will become a functional part of their work- 
ing and personal lives. 
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Remedk 1 Education Provided by Nine SDAs 
Visited by GAO; Summaries 



Assessment and Selection 
for Remedial Education 



The Center used the Wide Range Achievement Test (wrat) to assess the 
reading and math skills of all its S^etp participants. Initially, the Center 
had planned to use school records to assess the remedial needs of its 
applicants but found that the schools used various assessment instiTi- 
ments and conducted their testing at different times during the year. To 
have a uniform assessment, the Center staff administered the wrat 
themselves at the time the youths submitted their applications. 

The Center's srerp participants were given instruction regardless of 
their wrat score. It was assumed that all participants would benefit 
from some aspect of the instruction component, the Program Adminis- 
trator explained, particularly in light of the nontraditional nature of the 
instruction. The Center therefore decided to have all youths accepted 
into the Si'LTP participate in the education portion of the program. The 
only exception was for seven severely handicapped youths located in 
Flagstaff, who the Center staff determined during assessment would not 
benefit from the program or would disrupt training sessions. These 
youths were placed at worksites for the duration of the srar?. 

Of the 92 youths participating in remedial education, 8 or 8.7 percent 
were receiving some form of public assistance. Other characteristics of 
the youths in remedial education are presented in figures III.l and III.2. 



Providing Remedial While for the majority of its srar? participants the Center conducted the 

p . . . ^ remedial classes, it contracted for remediation for youths in outlying 

i^iUUCauon ^^^^^ ^^^^ Center operated the Flagstaff segment of the summer pro- 

gram, supplementing its staff with temporary instructors and 
facilitators hired by the Center. In addition, the Lake Powell institute, a 
vocational training facility located in Page, conducted the Page and 
Fredonia segments. The Institute's program, which cost about $1,100 
per participant, followed guidance provided by the Center. 

Except for the seven handicapped participants, each youth in the sum- 
mer program attended 1 day of instruction per week for 8 weeks during 
the summer in addition to receiving work experience 4 days each week. 
Instruction was divided into two 4-week phases. The Center's operating 
plan indicated the first phase would consist of instruction in basic aca- 
demic skills and job survival, with special interest projects and writing 
for the second phase. 

During phase 1 of the summer program, the training day was comprised 
of two 2-hour blocks of reading and math in the morning, followed by 4 

4g 
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14-15 16-17 18-21 




Male 
Fenial- 



hours of basic living skills and employability training in the afternoon. 
Mornings included instruction on development of sentences and 
paragraphs, use of reference materials, and reading. The reading 
instructor noted that he used newspaper and magazine articles, pam- 
phlets, product labels, and other commonplace items to encourage read- 
ing without intimidating tL* jaths. 

The in&tinictors attempted to develop writing skills through the use of 
various writing exercises and by requiring that tho youths maintain 
journals. Youths had to write at least three entries in their journals each 
week, according to the instructors, who periodically reviewed selected 
entries and provided feedback. The journals were an outlet for self- 
expression, the instructors said, and gave the Center a means of moni- 
toring progress on writing goals. 

Arithmetic instruction emphasized basic computations. Classes included 
the use of a calculator, performing simple geometric problems, personal 
budgeting, and checkbook simulations, as well as more traditional math 
problems. 
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Figure III.2: School Status of SYETP 
Youths Receiving Remediation- 
Flagstaff. Arizona 




High School Graduate 



7.6% 

Dropout 



Elementary/ Secondary Student 



Phase 2 of the summer program gave youths a learning experience in a 
selected area of special latercst. Participants, who could choose from a 
list of eight special interest topics, were grouped according to their selec- 
tion. The topics were nature, computers, chemical dependency, job com- 
munication skills, health professions, media, geology, and consumerism. 

Each group combined field trips with discussions on the subject topics 
and visits by guest speakers. Center staff acted as facilitators during 
group discussions and served as monitors during field trips. For exam- 
ple, we observed a class involved in the geology project, **Earth, Fire and 
Water," which visited an extinct volcanic peak, explored underground 
lava tubes, and studied an exposed cinder cone. Youths in the media 
project, **So You Want To Be a Star,'' visited local radio and television 
stations and toured the local university's drama department. Other 
groups visited hospitals, local landmarks such as the Grand Canyon, and 
discount department stores. 

At the completion of each 4-week phase, bonuses of $40, $30, and $20 
could be awarded to youths who accrued points for such program ele- 
ments as attendance, punctuality, journal writing, and completion of 
assignments. The bonus system was designed so that all participants 
could succeed regardless of academic status. This allowed youths to 
earn extra money during the summer program, while enabling the 
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Center to monitor their performance levels. As the Center intentionally 
did not want to assign grades to the youths' performance in the pro- 
gram, Center staff explained, they set up the bonus system as an alter- 
native. It was intended to provide feedback to the youths on their 
performance level as well as motivate program participation. 



Program Results Although the Center pre- and post-program-tested some of its partici- 

pants, problems with the test forced the Center to invalidate the test 
results midway through the summer program, the program administra- 
tor said. The Center lost confidence in the validity of the test results as 
an evaluation tool, primarily because too many people administered the 
tests incoiTectly. While acknowledging the difficulty in evaluating pro- 
gram results without pre- and post-program test data, the program 
administrator said the Center used its bonus system as a substitute eval- 
uation measure. 



Youths who received bonuses were considered by the Center's program 
director to have performed successfully during the training component. 
Those not receiving bonuses were deemed not to have performed suc- 
cessfully. Using data provided by the Center, we calculated that, during 
phase 1, 91 percent of the Si'ETP participants received bonuses, and 9 
percent earned no bonus money. During phase 2, 81 percent of the 
youths earned bonuses. 



Implementation For the Center administrators, the most difficult aspect of developing 

Difficulties and 1988 ^^^^ Flagstaff was that they did not know how to design a 

Program remedial education program that would work for their youths. Lacking 

experience with remedial si'ETP programs, the Center staff told us, they 
at first had trouble understanding what was required by the revised 
federal guidelines, as the guidelines were so general. They overcame this 
barrier by getting advice from the Coconino Private Industry Council, 
local school officials, the state jtpa liaison, other Si'ETP administrators, 
and community representatives. 

In 1988, the Center changed its instruction format. The two training 
phases ran concurrently, rather than successively. 
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Harrison, Arkansas 





Profile: 


1987 SYETP 


Administrative entity: 


North>*'est Arkansas Economic Development 


Distric< 


Geographic area served: 


Baxter, Benton, Boone, Carroll, Madison, 


Marion, Newton, Searcy, and V\bshington 




Counties 


Summer unemployment rate: 


4 percent 


Funding level: 


$569,000 


Number served: 


655 


1987 Remedial Component 


Had prior remediation: 


Yes 


Provider: 


Northwest Arkansas Economic Development 




District 


Assessment tools: 


School records 


Cost: 


$224,000 


Number served: 


150 


Average hours per person: 


240 


Youth paid to attend: 


Yes -$3.50 per hour 


Evaluation: 


Pre- and post-program test comparison 



The Northwest Arkansas Economic Development District is made up of 
nine counties in northwest Arkansas. Its program goal is to increase the 
educational and occupational skill levels of the District's citizens to meet 
the demands of the occupations of the 1980s. 

Including remedial education in its 1987 SiHETP has presented little diffi- 
culty because the District has had a remedial reading program using 
tutors since 1978. In 1986, the District added a pilot mathematics pro- 
gram, which became operational at some training sites in 1987. 



The sv^ETP in northwest Arkansas serves mainly 14- and 15-year-olds, 
giving them on-the-job.experience. Some older participants, however, 
may be selected for the program after the 14- and 15-year-olds have 
been placed. To assess participants, the District used school records giv- 
ing their reading and math Wels in the form of current achievement 
test scores. Out-of-school yo*.iths, limited to 16-year-old dropouts, were 



Assessment and Selection 
for Remedial Education 
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assessed by a vocational technical school. The 17- to 21-year-olds were 
referred to the II-A program. 

The assessments obtained by the District were not used, however, in 
selecting participants for remediation, which consisted of a tutoring pro- 
gram. Prior to beginning work experience, all program participants had 
to gc through a Job Club. The Job Club provided information to partici- 
pants on available work experience positions, acted as a screening 
device, and helped job counselors ph;ce participants in the most suitable 
training program. 

One work experience opportunity, the tutor program, was also the Dis- 
trict's remedial education program. Goals for tutors included reinforcing 
and maintaining their own basic readinj-' -skills, learning planning and 
organization skills, and improving interpersonal communicat*on skills. A 
participant who expressed an interest in the tutor program, who the 
Job Club counselor felt would do a good job as a tutor, was referred to a 
tutoring site. There, youths were interviewed and selected by a teacher. 
Special consideration was given to applicants who showed both a special 
interest in working with young children and sufficient mastery of basic 
reading skills. 

The primary motivations for youths who took the tutoring jobs, accord- 
ing to the program coordinator, were that the jobs had **prestige," paid 
higher salary, and were in air-conditioned rooms. Tutors received $3.50 
an hour, 15 cents more than the other summer jobs. The srarp work pro- 
grams pay youths $3.35 an hour. 

Of the 150 tutors, 15 (10 percent) were receiving afdc. While the sreip 
program overall was about 48 percent female, 71 percent of those 
selected as tutors (107 of the 150) were female. Other characteristics of 
tutoring program youths appear in figures IIL3 and IIL4. 



Providing Remedial The District's tutor program provided remediation to two groups: 

Education 

• The 150 srarp youths provided individualized tutorirg in reading and/or 
math to pupils in grades K-6 and 

• 21 teachers, certified in fields related to elementary education, oversaw 
the tutors and reviewed their lesson plans. 

The best way for the sv^etp youths to learn and improve their own read- 
ing and math skills, program officials said, is to teach. 
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Figure III.3: Age and Sex of SYETP ^■^■IH^H^^HHi^^ 



Youths Receiving Remediation* 
Harrison, Arkansas 




14-15 16-17 18-21 



] Male 
I Female 



Tutors spent 8 hours per day on the job, of which 2 hours were used for 
preparation and 6 for tutoring the K-6 grade students. The program ran 
for 5 weeks of 32 hours each and 2 weeks of 40 hours each for a total of 
240 hours. A tutor operated with a small group of pupils or one-on-one, 
the number depending on the number of pupils at the site and the ability 
of the tutor. Tutors with weaker skills worked with students in kinder- 
garten and first grade. At some locations, computers were used occa- 
sionally; at one location the math class was computer-aided. 



Program Results '^^ determine the effect of its tutoring program, the District pretested its 

tutors and their students. In addition, post-program tests were given to 
grade 2-6 students and to any tutor scoring lower than the 12.9 grade 
level on the pretest. In 1987, of 165 tutors,* 54 (33 percent) scored at the 
12.9 grade level on the pretest in reading, thus eliminating themselves 
from post-program testing. Only 134 tutors were pretested in math, with 



*The District's pre- and post-program test analysis covered all tutors — 150 funded by title II-B and 15 
by a state education grant We could not segregate the results by group. 
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34 (25 percent) scoring at the 12.9 grade level, according to program 
records. 

The Woodcock Mastery Reading Test and the Key Math Test were used 
to pre- and post-program-test tutors.^ In 1987, the reading test showed 
an average gain of 1.9 years for these tutors, the math test, 1.2 years. 

In addition, the tutor program was successful in remediation of grade 2- 
6 students. In 1987, 483 grade 2-6 students were tutored in reading with 
340 also receiving math tutoring. The students had an average increase 
of at least 5 months in their reading skill level and at least 6 months in 
math, according to test results obtained by the District. The remediation 
that produced these results did not exceed 12 total days per student. 



Implementation The District has been providing remediation through its tutoring pro- 

Dif f iculties and 1 988 since 1978. in 1987, the numbers of youths served, teachers, work- 

Program i^ouvs of work were reduced from the previous year. This was 

due to decreased program funding, not the remediation requirement, 
according to the Program Director. The District made no changes in its 
tutoring program for 1988. 



^Thcse are nationally developed tests used to determine the reading and math skill levels of the 
youths tested. 
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Bakersfield, California 



Profile: 


1987 SYETP 


Administrative entity: 


Employers* Training Resource 


Geographic area served; 


Kern, Inyo, and Mono Counties 


Summer unemployment rate: 


9.3 percent 


Funding level: 


$1,900,000 


Number served: 


1.743 


1987 Remedial Component 


Had prior remediation: 


Yes 


Provider: 


Six school districts, one college 


Assessment tools: 


School records, counseling 


Cost: 


$219,000 


Number served: 


859 


Average hours per person: 


Varied by provider (60-120) 


Youth paid to attend: 


Yes -$3.35 per hour 


Evaluation: 


Varied by provider 



Employers' Training Resource of Bakersfield administers jtpa programs 
for three counties in central California: Kern (in which it is located), 
Inyo, and Mono. In 1984, Kern Ck)unty, the most populous of the three, 
had a population of about 460,000; Inyo and Mono counties had about 
18,000 and 9,000, respectively. According to program staff, these coun- 
ties are a mix of urban and rural areas and have an unemployment rate 
that fluctuates seasonally between 10 and 17 percent. 

The program has provided remedial education in its arETP since 1986. 
The objective of its 1987 remediation component, as described in the 
operational plan, was to bolster participants' self-esteem. To do so, it 
was to 

• teach participants to appreciate the value of education in the job 
market; 

• encourage potential dropouts to stay in school by providing a positive 
school experience; 
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• improve participant aciidemic performance, including mathematics and 
reading comprehension; 

• assist youths to pass a proficiency exam, a msuor hurdle for graduation; 
and 

• help youths to see the relationship between successful classroom experi- 
ence and work-related experiences. 



Assessment and Selection The program contracted with eight school districts, three coUeges, and 
for Remedial Education county agencies to provide the 1987 srarp services, including assess- 

ment of participants and selection of those for remedial education. Of 
the 13 providers, 7 offered a remedial education component in 1987. We 
visited the throe largest providers in Kern County with remedial educa- 
tion programs: Kern High School District, Delano Joint Union High 
School District, and California State College, Bakersfield. 

These providers used a combination of school records and counseling 
sessions to determine whether a smrp participant needed remedial edu- 
cation. At each location, participants who failed the proficiency exam 
for reading, math, or writing generally were placed in remediation. 
After informally determining from participants' jtpa applications 
whether they would be eligible for the sraip, Kem High School district 
career counselors conferred with and assessed participants individually. 
At California State College, program administrators reviewed partici- 
pant transcripts during the second day of orientation to decide 3ligibility 
of participants for remedial education. At Delano, the jtpa coordinator 
examined participants' cumulative school folders and based his recom- 
mendations on passage of the proficiency examinations or tne number of 
credits deficient in math, reading, and/or writing. 

Of 859 participants in remedial education during the 1987 summer pro- 
gram, 362 (42.1 percent) were receiving some form of public assistance, 
with 260 receiving afdc. Other characteristics of the reinedial education 
enrollees appear in figures III.5 and III.6. 



Providing Remedial The Kem and Delano Joint Union High School Districts shared a goal for 

Education ^^^^^ remedial education programs. It was to help participants pass the 

proficiency exam so they could graduate from high school in California. 

The California State College Career Beginnings Program, on the other 

hand, sought to prevent participants from dropping out of high school 

and to assist them in planning their future. 
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Figure III.5: Age and Sex of SYETP ■■■■■■■■1 
Youths Receiving Remediation— 

Bakersfield, California Number of Paiilciptnt« 




14-15 16-17 ie-21 

Agt 



I I Male 




Female 



This difference in goals led to different curriculum emphases. Kern and 
Delano classes included topics likely to be encountered on the profi- 
ciency exams. Remedial classes v/ere similar to regular school classes, 
although some tailored the program more to youth with greater needs. 
But California State College instructors had more flexibility as to class- 
room structure and presentation, according to the program director, 
because their classes intended to provide enrichment to the participantG 
to keep them in school. For example, California State College offered 
computer literacy and speech classes along with remedial classes for 
reading and math. 

With each provider, the number and size of the Si'ETP remedial education 
classes differed. The Kern High School District Administrator set up 19 
remedial and 25 special education classes. All were exclusively for jtpa 
students, the former averaging about 22 students per class and the lat- 
ter about 10. In Delano, because of the small number srarp youths were 
placed in the same classes (average size, about 22 st-.dents) as regular 
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Figure IIL6: School Status of SYETP 
Youths Receiving Remediation— 
Bakersfield, California 




1,2% 

High School Graduate 

2,2% 

Dropout 



Elementary/ Secondary Student 



summer school students. California State College offered five classes for 
JTPA-Career Beginnings participants. The three providers differed some- 
what in their remedial education program format, according to their 
administrators; 



• Kern High School District participants generally attended classes for 2 
hours in the morning, with a 4-hour work component in the afternoon. 
The remedial component lasted 7 weeks, the work component, 9. 

• Delano participants worked 6 hours in the morning and went to school 2 
hours in the afternoon. Remedial classes lasted 6 weeks, the work com- 
ponent, 9, 

• California State College participants attended classes 3-1/4 hours in the 
morning and worked 4-1/4 hours in the afternoons, with classes lasting 
6 weeks and the work component, 8. 



Program Results The program had no requireme^-t that its providers formally evaluate 

the performance of its 1987 srerp participants. No provider adminis- 
tered a standard diagnostic test to sv^etp remedial education participants, 
according to the Employers' Training Deputy Director. Instead, he said, 
providers who used the proficiency exam for assessment could base 
their program evaluation on how many participants passed the exams 
by the end of the srerp. 
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The program reported that its 1987 Si^ETP remedial education program 
was a success. The major educational stumbling block for youths served 
by the remedial education program, staff said, was failure to pass the 
three proficiency exams, without which youths cannot obtain a high 
school diploma. The 1987 srar? remedial education program was 
designed to improve the academic skills necessary to pass the exams. Of 
the 291 youths who completed a remedial education class at Kern High 
School District (the largest of the seven remedial education providers), 
84 (29 percent) passed one of the proficiency exams. 



Program staff noted some difficulty in coordinating the remedial compo- 
nent vrith participants' work schedules. Some Si^ETP youths in outlying 
areas did not participate in the Kern High School District's remedial pro- 
gram because it would have taken too long to transport them from class 
to worksite. Thus, their work and school schedules could not be coordi- 
nated, according to the Administrator. 

One provider described discipline problems. The Ken District Adminis- 
trator said that he had received complaints from assistant principals 
that Si'ETP participants were troublesome, often tardy, and roamed the 
halls. He also said that some teachers called the a^ETP youths more diffi- 
cult to handle than regular summer school youth. 

Concerning participant tardiness and absenteeism from classes, a final 
issue emerged. At one school, instructors told us the school should estab- 
lish a policy for dealing with a^ETP youths who are frequently tardy or 
absent from class. Unsure of what action they could or should take, 
these instructors were concerned about the message the program was 
giving to students who were paid to attend class even when their attend- 
ance was inconsistent. 

The Kern High School District's a^ETP evaluation procedure was 
improved in 1988, the program administrator said. Proficiency exam 
test results did not effectively reflect the summer performance of Si^ETP 
youths, the administrator declared. He said the results provided no 
bench mark against which to measure a gain or lo5s in performance 
attributable to the summer program. Without pre- and post-program 
tests, it was difficult to evaluate the accomplishments of youths in the 
special education component, according to a program official. In 1988, 
the California Aptitude 'I'est was used to pre- and post-test program 
participants. 
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North Windham, 
Connecticut 



Profile: 


1987SYETP 


Administrative entity: 


Northwest Danielson-Williamantic Service 




Delivery Area (EASTCONN) 


Geographic area served: 


Eighteen towns— Ashford, Brooklyn. 




Canterbury, Chaplin. Eastford, Hampton, 




Killingly, Lebanon, Plainfield, Mansfield, 




Pomfret, Scotland. Putnam, Union. Sterllr^g, 




Windham, Thompson, and Woodstock 


Summer unemployment rate: 


3.7 percent 


Funding level: 


$378,000 


Number served; 


315 


1987 Remedial Component 


Had prior remediation: 


Yes 


Provider; 


Two community-based organizations 


Assessment tools: 


None 


Cost: 


$91,000 


Number served: 


28 


Average hours per person: 


12 (computer training), 150 (tutor program) 


Youth paid to attend: 


Yes -$3.37 per hour 



Evaluation; None 



The Northeast Danielson-Williamantic Service Delivery Area encom- 
passes 18 towns in the northeast comer of Connecticut. This rural area 
had a remedial program in 1986. Youths either attended computer- 
assisted instruction or were assigned as tutors. 



Assessment and Selection The program's remediation goal was to provide basic skills education to 
for Remedial EdUCt*tion youths assessed as requiring remedial education to improve chances for 

successful employment. Program officials, however, were unsure if all 
youths were to be assessed or only those receiving remedial education. 
As it turned out, however, none of the 1987 SfEiV youths had their read- 
ing anu math skills assessed. This oversight occurred, we were told, 
because the position of Director of Training and Development had been 
vacant for almost a year and these duties were handled by other pro- 
gram officials. 
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The s/A contracted with a local community-based organization, the 
Quinebaug Valley Youth Services Bureau, Inc., to operate the 1987 sum- 
mer prog^-am. The Bureau's staff interviewed paiticipating youths and 
explained the types of work experience and programs available. During 
these interviews, youths were informed of the two educational compo- 
nents, computer-assisted instruction and tutoring, both voluntary. 
According to the remediation contractors, 28 youths participated ui 
remedic'. education, 16 in computer-assisted instniction, and 12 in the 
tutor program. 

Of the 28 remedial education participants, 11 were receiving some form 
of public assistance. Other characteristics of the youth receiving 
remediation appear in figures III.7 and III.8. 



The computer-assisted remediation program was a self-paced instruction 
that youths attended 2 hours per week for 6 weeks, along with approxi- 
mately 28 hours per week in work experience. Youths were not evalu- 
ated to determine their prior reading or math skill levels. Rather, 
remediation instructors said, the area of instruction followed by each 
youth was based on either the instructor's observation of the youth's 
need or the youth's own interest. Some of the areas of instruction 
included math, English, general science, and computer operations. 

While some youths in the remedial program were in need of remediation, 
others were not, according to a program official. To that extent, some of 
the youths participated in remediation, but others played computer 
games or experimented with programming or printout applications as 
part of their training. Thus, the remedial training enabled some of the 
youths to improve their reading and math capabilities, while others 
broadened their computer knowledge and practiced various computer 
applications. Consequently, to expect an achievement gain for some of 
the participants was not realistic, said a program official. 

The Quinebaug Valley Youth Services Bureau subcontracted its remedial 
tutor program vnth Northeast Regional Adult Education. Youths placed 
in the tutoring program were tested for attitude, not skills. They spent 
30 hours a week in class for 5 weeks, tutoring summer school youths in 
reading and th. The tutor program thus served as both the partici- 
pant's remedi<\tion and work experience. 
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Figure IIL7: Age and Sex of SYETP ■■^■i^^H^H 
Youths Receiving Remediation— North 

Windham, Connecticut Numbtr of Participants 



Figure III.8: School Status of SYETP 
Youths Receiving Remediation— North 
Windham, Connecticut 
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Program Results 



Because neither the program nor the remediation providers pre- or post- 
tested the reading and math skills of the participating youths, program 
officials said they could provide no information on the results of their 
remedial efforts. 



Implementation 
Difficulties and 1988 
Program 



The program had a problem in attracting summer youth, officials said, 
explaining that local businesses paid higher wages than the $3.37 per 
hour available from the program. ?or example, a fast food restaurant 
paid up to $5 per hour. In 1988, the state of Connecticut raised the mini- 
mum wage to $3.75 per hour which, r'^cnrding to the program coordina- 
tor, allowed the sda to compete with p ate employers. In addition, the 
program concentrated on recruiting 14 ind 15-year-olds because this 
group is too young to qualify for the higher paying jobs. 

To eliminate the assessment problems of the 1987 program, o^'ficials 
took a more active role in planning and implementing the remedial pro- 
gram. They assessed all youths, using the Wide Range Achievement 
Test. All youths who tested two grades below their current grade were 
required to attend remediation. Youths determined to need remediation 
were required to attend classes in order to get a job. Remediation con- 
sisted of a computer-assisted instruction package by which the youths 
were tested and advanced as warranted with the results recorded for 
instructor review. Eighty youths received remediation in 1988. At the 
end of the prograrn, the initial standardized test was readministered as a 
post-program test to determine the youths' progress. As of August 1988, 
the SDA was just beginning to analyze the post-test scores. 
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Fort Myers, Florida 



Profile: 


1987SYETP 


Administrative entity: 


Lee County Private Industry Council 


Geographic area served: 


Lee County 


Summer unemployment rate: 


4.0 percent 


Funding level: 


$292,790 


Number served: 


312 


1987 Remedial Component 


Had prior remediation: 


No 


Provider: 


School board 


Assessment tools: 


School records, basic skills test 


Cost: 


$50,000 


Number served: 


86 


Average hours per person: 


12 


Youth paid to attend: 


Yes • $3.35 per hour 


Evaluation: 


Pre- and post-program test comparison 



The Lee C!ounty Private Industry Ck)uncil (pic) of southern Florida cov- 
ers the cities of Fort Myers, Cape Coral, and Sanibel, and has an esti- 
mated population of approximately 241,001. Prior to the 1986 
requirement to assess the reading and math skills of all 1987 eyetp par- 
ticipants and expend funds for basic and remedial education, the Pic 
provided only work experience. In late 1986, however, after approving 
the purchase with jtpa title II-A funds of computer hardware and soft- 
ware for a remedial education program, pic officials decided to use them 
for the 1987 summer program. 



The county Pic assessed all 3i eyetp participants for reading and math 
skills. For in-school youths, the Lee County School Board determined 
each youth's performance level under an agreement with the pic. This 
determination, based on the previous year's California Achievement 
Test' scores, included designations for youths who were 0-1 years below 
the level they should have been for their grade, 1-2 years below, and 
more than 2 years below. Out-of-school youths- -both dropouts and 



'The California Achievement Test is a nationally normed referenced achievement test in reading, 
language, and math given at individual grade levels. 
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graduates — were assessed by means of the Test of Adult Basic 
Education.** 

For in-school youths, the piC used informatic, returned from the school 
board to select participants for remedial education. Out-of-school youth 
were tested by the program. Both in-school and out-of-school youths 
identified as being two or more grades below their current grade were 
targeted for the remedial program. 

The PIC planned to provide remediation to 100 participants but only 86 
received it. Lack of time to get test scores from school and the limited 
number of computer terminals available prevented its accommodating 
the higher figure. 

Of the 86 youths given remediation, 77 were receiving some form of 
public assistance. Other characteristics of the remedial education youths 
appear in figures III.9 and IILIO. 



''The Test of Adult Basic Education is a nationally normcd achievement test adapted from the Califor- 
nia Achievement Test in reading, language, and math to indicate tlie individuals' knowledge level. 
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Figure liL9: Age and Sex of SYETP ■■■■■■■■■■ 
Youths Receiving Remediation— Fort 

MyerSi Florida 30 Numbtr of Participants 



0 
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Figure 111.10: School Status of SYETP 
Youths Receiving Remediation— Fort 
Myers, Florida 
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Providing Remedial "^^^ S^^^ County pic's remediation program was to raise the read- 

Education math levels of the participating youths and improve partici- 

pants' attendance during regular school hours. To accomplish these 
goals, the pic contracted with the Lee County School Board to provide 
facilities, instructors, and instructional materials and assess student 
progress for the remediation program. 

The only type of remediation the pic offered was the **Project Uplift'' 
computer-assisted instruction. Under this program, the youths were 
instructed and daily tested by computer. The curriculum was part of a 
software package the pic purchased from the Computer Curriculum 
Corporation.^ 

Each participant attended a daily, 20-minute remedial education class 
and received approximately 30 hours per week in work experience over 
a 7-week period, according to Pic officials. Youth who were only in the 
work experience component of the prc<;ram had about a 35-hour work- 
week. Remedial education was provided at one of two locations: a local 
high school or the area vocational-technical school. Starting from a 
youth's initia] assessment, the instructor established a level at which the 
youth was to start on the computer. After 10 sessions, the computer was 
used to update this base with results of the youth's performance. In test- 
ing the youth daily and recording the results, both with the computer, 
the instructor obtained the current status of each youth's progress with 
which to focus individual instruction on areas of greatest need. The pic 
paid participants $3.35 per hour for their remedial training as well as 
their work experience. 



Program Results '^^^ school board determined the results of the remediation program by 

a youth's pre- and post-program test scores on the computer. To record 
any type of gain or loss, a youth had to .^spend a total of 100 minutes on 
the computer. Records available for 86 participants in 1987 showed a 
gain for 38 from 0.01 to 5.16 grades with m average of 0.49 grades. At 
the same time, 11 participants showed losses of 0.01 to 0.80 grades for 
an average of 0.33 grades. The remaining 37 participants showed no 
gain because they failed to complete the 10 sessions required to estab- 
lish a baseline level. 



^Computer CurricuJ»am Corporation is an independent corporation providing computer software pro- 
grams to educational institutions in the areas of reading, math, language skills, and computers. 
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Implementation The pic experienced some difficulties in planning how the remedial pro- 

Difficulties and 1988 would operate, a PIC official said. It would have found helpful 

Program additional information, including clarifying guidelines or examples on 

^ the intent of the Congress as to the mandatory assessment of all partici- 

pants. He cited having a remedial education program under the Pic*s jtpa 
title II-A program as a major benefit in minimizing the difficulties of 
implementing a title II-B program. 

For its 1988 program, the PiC served 110 youths and used the same 
assessment process and remedial instruction as in 1987. The PiC declared 
all youths who were below the:^ present grade level eligible for remedia- 
tiOx., as opposed to enrolling only youths 2 years or more below grade 
level. According to a Pic official, 93 of the 110 remediation participants 
showed a gain. 
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Ottawa, Illinois 



Profile: 



1987 SYETP 


Administrative entity: 


Business Employment Skills Team - SDA #12 


Geographic area served: 


Bureau, LaSalle. Lee, and Putnam Counties 


Summer unemployment rate: 


9.7 


Funding level: 


$555,000 



Nursi:er served: 368 



1987 Remedial Component 


Had prior remediation: 


For out-of-school youth only 


Provider: 


Two high schools, two community colleges, 




and the SDA 


Assessment tools: 


School records and Test of Adult Basic 




Education 


Cost: 


$32,479 


Number served: 


84 


Average hours per person: 


50-90 


Youth paid to attend: 


No 


Evaluation: 


Pre- and post-program tost and high 




school equivalency exam 



The SDA, which operates under the name Busmess Employment Skills 
Team, Inc., administers jtpa programs in four counties in north central 
Illinois. The counties aie predominantly rural — Ottawa with a popula- 
tion of 18,000 is the largest city. The objective of the summer program 
was to provide well-supervised, meaningful work and training experi- 
ence to youth during the summer months to encourage them to remain in 
school and/or otherwise continue their education and career develop- 
ment. In addition, the program sought to m.aintain or improve the read- 
ing and math skills of youth in the remedial component. 



Assessment and Selection 
for Remodjal Education 



The program began recruiting in February 1987 at various schools and 
through radio and newspaper advertisements. Literature on the summer 
program was sent to all families on afdc in the four-county area. Pri- 
marily, remediation was provided to 16- to 21-year-old in-school youth 
found to be two or more grades below thsir current grade in either math 
or reading. Grade-level determinations were based on school records, if 
available, or T'est of Adult Basic Education results. School drop-outs 
were enrolled in the ged (general equivalency diploma) program. The 
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program determined educational needs from tests administered by the 
two community colleges providing the ged programs. 

Ii -school youth determined in need of remediation and all out-of-school 
youth were required to attend classes as a condition of getting a summer 
job through the program. Eighty-four program participants (22 percent) 
received remediation. Characteristics of remedial education enroUees 
appear in figures III.ll and III.12. 



Figure 111.11: Age and Sex of SYETP 
Youths Receiving Remediation— Ottawa, 
Illinois 



30 Nui». 3r of Participants 



25 




The program provided remediation to fewer youth than planned, partly 
because they had difficulty ge:;ting to locations v^^here the remediation 
was available. 
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Providing Remedial '^^^ program itself and (through contract) two high schools provided 

FdiiPJitinn remediation to in-school and some out-of-school youth. Other out-of- 

school youth were given remediation through contracts with two com- 
munity colleges. The program expenmen">ed with various approaches in 
providing remediation. Remediation and work experience were provided 
concurrently. 

At Ottawa High School, classes were held for 21 youth for 30 days (5 
days a week for 6 weeks). Their daily classes comprised thre^ 1-hour 
sessions in math, reading, and career education — a total of about 90 
hours of remediation during the summer. Three certified teachers, two 
teachers aides, and one part-time vocational diagnostician provided the 
training. The amount paid to ^-.le high school was based in part on 
youths' maintaining or improving competency levels in the areas of aca- 
demic deficiency. 

At Hall High School, 21 youth e^tch day attended 3.5 hours of instruction 
in math, reading, writing, speaking, and listening. The program, lasting 
17 days, totaled about 60 hours. Instruction, provided by three certified 
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teachers, included computer skills training in preparing resumes and let- 
ters. The program objective was to enhance the participants' 
er ^iloyability. 

The program itself provided remediation to 20 youth in a less traditional 
manner, fouth attended one 3.5-hour class per week for 9 weeks at loca- 
tions of the participants' choosing, usually a pavilion at a local park. 
Among the subjects were reading, math, and study, problem-solving, and 
computer skills. Remediation was provided by one certified teacher and 
two aides — the latter summer program participants whose summer job 
was to teach youth in the remedial component of the program. In addi- 
tion to the vv^e'ikly sessions, the aides tutored youth in two 1-hour ses- 
sions in reading and math at their work sites. In total, youth in this 
program received about 50 hours of remediation. 

Twenty-two out-of-school youth received remediation at two community 
colleges— 15 at Illinois Valley Community College snd 7 at Sauk VaUuy 
Community College. In both programs, youth attended one 6-iiour class 
per week for 10 weeks— a total of 60 hours. The ged instruction 
included math, reading, social studies, science, and writing skills. 

Except for Hall High School, the remediation and work experience was 
provided concurrently. At Hall High School, remediation was provided 
early in the summer, before the youth were given a job. 



Remedial Education On average, the three programs for in-?chool youth resulted i.. .iiath and 

Results reading gains. Youth attending classes at Hall High School had average 

gains of 1.15 grades in math and 1.75 grades in reading. This component 
of their remedial effort had the shortest duration and the highest par- 
ticipant completion rate. The length of the program and the promise of a 
40-hour-a-week job to follow may have had a positive effect, a program 
official told us. 

The Ottawa High School program showed average gains of 2.3 grades in 
math and 0.77 in reading. The component operated by the program had 
average gains of 1.0 grade in math and 0.8 in reading; according tc a 
post-program assessment prepared by the program, the length of both 
components may have been a weakness in the program and had a detri- 
mental effect on the participants' motivation. 

The results of the GED program are not easily quantified. Youth may not 
take the ged test until they are 18 years old or their high school class 
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graduates. Of youth in the Ged training, only six were eligible to take the 
test. Of these, three passed and received their diplomas. 

According to a post-program survey and our discussions with them, the 
youth were satisfied with the program. However, several expressed 
interest in getting paid for the time spent in remediation or being able to 
work additional hours to offset the time spent in remediation. 



Implementation 
Difficulties and 1988 



Program 



Of the 84 youths who received remediation, 57 completed the pro- 
gram — a 32-percent drop-out rate. Of the 27 who dropped out of the 
remedial component, the majority attended the community college- 
administered GED program. At Hall High School, which had the shortest 
progn \n, no youth left the program prematurely. The remedial effoits 
operat,id by Ottawa High School and the program had drop-out rates of 
38 and 25 percent, respectively. A program assessment indicated con- 
cern over the length of these programs, which were conducted later in 
the summer, and youth not receiving payment for their time in 
remediation. 



Iri the 1988 program, officials said, some youth received cash stipends. 
Youths enrolled in remedial education who attended 90 percent of their 
scheduled classes and either maintained or improved on tneir pretest 
scores upon completing the remedial component were paid $3,00 per 
hour for each hour spent in remedial education. 



75 

O Page 75 GAO/HRI>88-118 Remedial Education in Summer Jobs Program 

ERIC 



Appendix IH 

Remedial Education Provided by Nine SDAs 
Visited by GAO: Summaries 



Pittsburgh, Pennsylvania 



Profile: 




1987SYETP 


Administrative entity: 


City of Pittsburgh, Department of Personnel 




and Civil Service Commission, Employment 




ano Training Grant Administration 


Geographic area served: 


City of Pittsburgh 


Summer unemployment rate: 


6.6 percent 


Funding level: 


$1,759,000 


Number served: 


1.835 


1987 Remedial Component 


Had prior remediation: 


No 


Provider: 


School district 


Assessment tools: 


School records, basic skills test 


Cost: 


$1o,964 


Number served: 


243 


Average hours per person: 


60 or 120 


Youth paid to attend: 


Yes • $4 per day (for lunch and 




transportation) 


Evaluation: 


Pass/fail on summer school classes 



The Pittsburgh Service Delivery Area covers the geographic boundaries 
of Pittsburgh, Pennsylvania— a large urban area witn a diversified 
industrial base. The latter includes manufacturing, construction, trans- 
portation, education, utilities, banking, insurance, and government. 
Prior to 1987, Pittsburgh provided only work experience to youths 
under the title II-B program. The city first provided remedial education 
in the summer of 1987, using the Pittsburgh School District's summer 
school program to do so. 



Assessment and Selection Pittsburgh planned for provision of remedial education to s^ctp partici- 
for Remedial Education determined to be in need of substantial improvement in reading 

and mathematics skill levels. All s^etp participants were assessed for 
remedial education, in-school youths by the School District and out-of- 
school participants by Pittsburgh's youth orientation assessment 
contractor. 
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Selection of youths for remedial education was based on school district 
referrals of 14- and 15-year-olds whose reading levels were below aver- 
age. Those eligible to attend the school district's sponsored sununer 
school were encouraged to apply to the SfEfTP program for remedial edu- 
cation training. Program staff and the School District worked together to 
ensure that in-school youths were identified and referred for remedial 
education through a^ETP as appropriate. 

To assess in-school youths, the School District used the results of the 
standardized California Achievement Test, given as part of the normal 
school program, the School District's Summer Program Coordinator said. 
Using these results, the School District determirted which youths would 
attend remedial education, which was provided through the city's usual 
summer school program. 

Out-of-school youths were given a self-evaluation test geared towards 
employment and a math and reading assessment test. According to the 
sv'ETP Coordinator, as the out-of-school youths were not eligible for the 
School District's summer school program, these assessments were not 
used to provide remediation. While the program allowed 16- to 21-year- 
olds to be given remedial education on an individualized basis, according 
to Pittsburgh's Assistant Director for Personnel, this was not done 
because funding was unavailable. 

Of the 243 youths participating in Pittsburgh's remediation program, 
184 were receiving some form of public assistance. More characteristics 
of the youth in remedial education are presented in figures III. 13 and 
III.14. 



Rather than develop its own program, Pittsburgh adopted the School 
District's summer school program as its II-B remedial education pro- 
gram, according to a program official. The program served a^ETP-eligibic 
youths who failed one or more subjects and needed to take up to two 
academic courses for credit in order to return to school with their own 
class in the fall. 

The II-B youths were in the same classroom as other youths participat- 
ing in summer school. The two types of students dixfered in that the II-B 
youth received a needs-based payment for lunch and transportation of 
$4 per day. 
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The 1987 Pittsburgh Summer School Program was offered at two high 
schools in Pittsburgh, for 4 weeks, Monday through Friday. Each youth 
took up to two courses, 3 hours each, depending on what courses they 
needed to advance to the next grade level. The courses were the normal 
summer school programs, e.g., social science, English, math, American 
history, and biology. Teachers provided classroom work through lec- 
tures, using textbooks — no computers were used. The youths in summer 
school could take up to two courses that they did not pass during the 
regular school year. 

In addition to the normal summer school, the School District offered Pro- 
ject Second Chance (developed under title II-A). This project gave ninth- 
grade students who failed the first three grading periods intense reme- 
dial education. Eligible Second Chance youths were transferred to srarp 
on July 1, 1987, according to the School District's Summer Coordinator. 
The 78 youths enrolled in Project Second Chance were divided among 
four high schools and took four courses — ^English, math, science, and 
social studies. 
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The Second Chance youth were provided academic remediation to facili- 
tate educational progress and encouraged to stay in school. The enroU- 
ees were transferred into title II-B on July 1. The other youths who 
wanted to advance to the next grade would have had to participate in 
summer school, even without the a'ETP. 

The summer school instructors — including those for Project Second 
Chance — were selected from among certified teachers in the School Dis- 
trict who jid on the jobs. The criteria for selection were seniority and 
previous summer school experience. 



Results Because youths in the summer school program were not pre- or post- 

program-tested, there was no way to determine if their reading and 
math skills improved, according to the program's Assistant Director for 
Personnel. Instead, measurement of the success of the youth remedia- 
tion was based on the results of the youths' participation in summer 
school If the youth passed summer school, he or she advanced to the 
next grade and the program was considered successful. Of the 165 fVET? 
youths who started the summer school program, 158 completed it and 
135 passed and received academic credit for the courses taken. Of the 78 
Project Second Chance youths, 76 advanced to the lOtb grade. 
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Implementation Pittsburgh had no problems assessing the reading and math skills of all 

Difficulties and 1988 youths and providing remedial education to some, because it used 

Program existing school achievement results as assessments, according to the 

program's Assistant Director for Personnel. But doing so increased the 
program's administrative cost and doubled the paper flow from the pre- 
vious year. The School ^-.strict evaluated all students at the end of the 
school year. Those who failed to advance with their class had to attend 
summer school if they wanted to stay with their class. 

The program did reduce the number of workdays and total number of 
hours worked because of a reduction in funding, the Assistant Director 
said. The remedial requirement also reduced the length of the work 
experience from 7 to 5 weeks and from 35 to 20 hours per week. 

Pittsburgh changed the remedial education portion of the 1988 Si'ETP. 
This was done in response to a state of Pennsylvania letter of October 6, 
1987, that advised that remediation courses were to provide educational 
assistance to participants assessed as deficient in basic reading and/or 
basic math. Summer school normally provided by school districts, the 
letter said, was not considered remediation. In 1988, Pittsburgh subcon- 
tracted the remedial education program with the Boys and Girls Clubs. 
Under this contract, remediation and work experience was provided to 
50 yoaths. The remediation was one-half day, 5 days per week, for 4 
weeks. Youths were assessed using the California Achievement Test. 
Because youths and parents liked the program, Pittsburgh plans on con- 
tinuing the effort in future years. 
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Carrizo Springs, Texas 



Profile: 


1987SYETP 


Administrative entity: 


Middle Rio Grande Development Council 


Geographic area served: 


Dimmit, Edwards, Kinney, LaSalle, Maverick, 


Real, LValde. Val Verde, and Zavala Counties 


Summer unemployment rate: 


16.6 percent 


Funding level: 


$904,513 


Number served: 


815 


1987 Remedial Component 


Had prior remediation: 


No 


Provider: 


Council 


Assessment tools: 


Brigance Diagnostic Inventory of Essential 




Skills 


Cost: 


$159,087 


Number served: 


815 


Average hours per person: 


42 


Youth paid to attend: 


Yes - $3.35 per hour 


Evaluation: 


Pre- and post-program test comparison 



The Middle Rio Grande Development Council has operated the jtpa title 
II-B Summer Youth Employment and Training Program since the pro- 
gram began in September 1983. Headquartered in Carrizo Sprliigs, 
Texas, the Council serves nine counties in southwest Texas covering an 
area of about 14,000 square miles. This area's population will be about 
145,000 in 1988, with 78 percent of Hispanic origin, according to the 
Census Bureau. 

Prior to 1987, the program offered only work experience to eligible 
youths. The overall goal of the 1987 summer program wa<^ to improve 
school retention, academic performance, and employability skills of the 
participating economically disadvantaged youths. To help meet this 
goal, the Council added a remedial education component to its summer 
program. It sought to provide classroom training to at least 400 partici- 
pants identified as deficient in reading and/or math and to have 25 per- 
cent show progress through post-program testing. 
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The program intended to use school records to assess the reading and 
math skills of youths. As school records were unavailable to the stu- 
dents or the program until June, there was insufficient time to deter- 
mine the reading and math skill levels of the participants prior to the 
start of the program. Tho lack of information on participant skill level 
pr wented the program from determining which participants were most 
' . need of remediation. Therefore, to ensure that those in need of 
v^iediation received it, the program required all 815 participants to 
attend remedial education. With all youths receiving remedial education, 
the demographic characteristics of remedial education were the same as 
those for the program. 

The program tested participants on their first scheduled day of Si'ETP 
classroom training, using the Brigance Diagnostic Inventory of Essential 
Skills as the assessment tool. Of the 815 participants, 755 (93 percent) 
were pretested in b^th reading and math. For youths with grade-level 
test results, 58 achieved the maximum measurable levei in math and 
reading. This test only measures math skill levels to the 8th grade and 
reading skill levels to the 1 1th grade. Because vork experience sched- 
ules were in place, all youths were required to continue to attend reme- 
dial education each week on their assigned day. The pretest was used to 
determine at which level each youth was functioning and what specific 
areas needed remediation, rather than who should attend remedial 
classes. Some youths who tested at the maximum measurable level were 
used to tutor other participants. 



The remedial education component was aimed primarily at improving 
participants' reading and math skills. In addition, the Council wanted to 
develop participants' preemployment skills and heighten their drug and 
alcohol abuse awareness. These objectives were accomplished by provid- 
ing each youth with 1 day of classroom training per week for 7 weeks. 
Classroom training included four sections each in 1-1/2 hour segments: 
reading, math, preemployment skills, and prevention of drug and alco- 
hol abuse. 

Each of the six locations providing classroom training had one instnic- 
tor. Class sizes varied by location. For example, at a location we visiCed, 
the average class size was about 30 each day. At another location, the 
class size was about 18 each day. Classroom training used lectures, wj<-h- 
out computers. Instruction in reading and math was based on the mate- 
rial provided with the Brigance testing package. Individual instru-^X)rs 
selected materials to supplement this. The Brigance testing/curriculum 
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package allows for an educational intervention aimed at the partici- 
pants' specific needs, the program director said. For example, testing 
may indicate a youth is at a satisfactory skill level in word recognition, 
but weak in reading comprehension. The Brigance curriculum allov/s the 
instructor to select specific exercises to develop specific skills. In the 
classrooms we visited, the instructors had grouped the youths by level 
of ability and assigned specific exercises based on individual skill levels. 



Remedial Education '^^^ program provided us with grade-level, pre- and posNprogram test 

Results results for 461 (57 percent)^ of the 815 participants. Of the 461 partici- 

pants, 272 (59 percent) improved at least one grade level in reading, 
while 216 (47 percent) improved at least one grade level in math. Some 
participants' skills declined: 20 (4 percent) declined at least one grade 
level in reading and 66 (14 percent), at least one in math. For 169 youths 
(39 percent), there was no change in the tested grade levels in reading 
and for 179 (39 percent), no change in grade level in math. The tests 
only measured results to the 11th grade in reading and the 8th grade in 
math. Therefore, youths could be functioning at grade levels higher than 
these. 



For various reasons, test scores were unavailable for some youths. For 
exaniple, about 150 youths at one site were not post-program-tested 
because, the instructor said, she spent 1 week of training sessions revis- 
ing the training material. At another site, the instructor quit during the 
last week of the program, resulting in no post-program test for another 
62 youths, according to the field services manager. Finally, participants 
missed either pre- or post-program test sessions for other reasons, 
including the need to attend summer school. 



The program provided remedial education as part of its 1987 Si^TP in 
response to the 1986 jt?a amendments, according to the Field Service 
Manager. The major effect was that each youth was available to an 
employer for 24 hours, instead of 32 as in the past. But this was offset 
by increased funding, which allowed the program to serve 350 more 
youths in 1987 than 1986. 

Among changes to the remedial education program in 1988 was the use 
of a computer-as'^isted training program. Equipment and materials 



^Raw test results instead of gja^e^level were provided for 32 participants and could not be included 
in our analysis. O (j 
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bought in September 1987 with title II-A funds were used in the II-A 
program for academic remediation and computer literacy. In addition, 
the program addressed the need to assess youths before the start of the 
II-B program to determine those in need of remediation. At the time 
youths applied for services and were certified, the program either 
obtained current (within the past 6 months) school test results or 
assessed the new enroUee using the Brigance Diagnostic Test. For most 
participants, assessment was ased because school test results were not 
current in April 1988 when intake was conducted. 

Remediation was provided to 450 (35 percent) of the 1,300 sv^etp partici- 
pants. Fewer were served than in 1987 because the remediation compo- 
nent was lengthened. Youths were in class for 32 hours each week for 3 
weeks — a total of 96 hours. Youths who tested at least two grades 
belovi' their school level were eligible. According to a program official, 
initial results indicate that youth improved 2.9 grades in reading and 2.5 
grades iri math. 
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Farmington, Utah 





Profile: 


1987 SYETP 


Administrative entity: 


Davis County Employment and Training 


Office 


Geographic area served: 


Davis County 


Summer unemployment rate: 


5.4. percent 


Funding level: 


$152,000 


Number served: 


100 


1987 Remedial Component 


Had prior remediation: 


Yes 


Provider: 


Job Corps Center 


Assessment tools: 


School records, informally by office staff 


Cost: 


$59.5C/0 


Number served: 


49 


Average hours per person: 


165 


Youth paid to attend: 


Yes -$3.35 per hour 


Evaluation: 


Pre- and post-program test compa'ison 



The Davis Ck)unty Employment and Training Office in Farmington, 
Utah, administers jtpa programs for the county. Davis County, about 15 
miles north of Salt Lake City, is a mix of urban and rural areas. Layton, 
Utah, with about 38,500 residents, and Bountiful, about 34,000, are the 
two largest towns. Other towns in the county have fewer than 20,000 
people. 

Davis County's 1987 SV'ETP literacy program stemmed from a 1986 pro- 
ject to combat illiteracy in Utah. According to the Utah state jtpa coordi- 
nator, a synthesis of federal, state, and local interests helped create the 
county's 1986 Literacy Training Project. The Department of Labor 
wanted to test a joint effort between the Davis County Office of Employ- 
iitent and Training and the Clearfield Job v. jrps Center, while the Da^/is 
County PIC sought to improve the basic educational competency of 
youths entering the local workplace. The result was the sv'ETP literacy 
program, administered by the Davis County Employment and Training 
Office, provided by the Clearfield Job Corps Center, and monitored by 
the state of Utah. 
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The sununer program targeted welfare recipients and school dropouts 
for enrollment, 20 and 15 percent, respectively. As a goal, 90 percent of 
participant were to improve reading and math skills by one grade level, 
and half of the participants were to earn high school credits. 



Assessment and Selection The reading and math skills of all 1987 srerp participants were assessed 
for Remedial Education during the application interview. In-school applicants had to bring to the 

application interview a "literacy form" completed bj Lholr school coun- 
selor indicating their grade levels for reading and math. Applicants who 
were below grade level in either area were eligible foi the literacy pro- 
gram. The ability of out-of-school youths to fill out the forms and con- 
duct themselves during the interview was informally assessed by a 
program interviewer. If the interviewer believed they were deficient, 
they could be placed in the literacy program as well. Of 16 out-of-school 
youths who participated in the summer program, 8 were placed in reme- 
dial education. 

All youths deemed deficient during the initial assessment w^re pretested 
as an additional screening step. The remediation provider— the 
Clearfield Job Ck)rps Center—administered McGraw Hill's standardized 
Test of Adult Basic Education to 57 s^etp participants to determine their 
grade-level performance in reading and math. Those who fell below the 
7.5 grade level for reading oi 7.0 for math were enrolled in the literacy 
program. ?articipants whose scores exceeded both cut-off points were 
transferred to the work experience portion of the program. Of the 57 
youths who took the test in 1987, 50 fell below one or both cut-off 
scores. One youth judged in need of remediation dropped out of the pro- 
gram before it started, leaving 49 in remediation. 

Of the 49 remedial education youths, 9 (or 18.4 percent) were receiving 
some form of public assistance. Additional characteristics of the reme- 
dial education youths are shown in figures III.15 and III.16. 



Providing Remedial The Clearfield job Corps Center provided remediation services for the 

Education ^^^^^ County Literacy Program in a school building on the Center's 

facility in Clearfield, Utah. While kept separate from the Job Corps 
enroUees, the Si'ETP participants received training in the Job Corps class- 
rooms. The program transported its youths to and Irom the Job Corps 
site. 
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Figure IIM5: Age and Sex of SYETP 



Youths Receiving Remediation 
Farmington, Utah 




The literacy program courses occupied two 3-hour sessions, 5 days a 
week. Each participant attended one session and worked at the job site 
during the other. In-school youths received 11 weeks of remediation, 
while out-of-school youths spent 14 weeks in remediation. 



The Job Corps curriculum consisted of reading, nuithematics, and a 
"world of work" course. The instructors used basic Job Corps course 
outlines, supplemented as they saw fit. For reading and math, they com- 
bined lectures find personal tutoring — no computers were used. In the 
classrooms we visited, the instructors used materials geared to the indi- 
vidual abilities of the students. Such an approach was practical, the 
instructors believed, as class size averaged about 10. 

The world-of-work course is a part of the Job Corps basic education pro- 
gram designed to expv^se youths to work rules, job etiquette, and real 
work situations, according to the Job Corps' manager of academic pro- 
grams. Students are exp )sed to such topics as working with other people 
and employers, decision-making, problem-solving, and personal finance. 
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m 



Also, participants share their on-the-job experiences and problems with 
their fellow students in class. 



Program Results '^^ determine the level of academic achievement during the summer pro- 

gram, the Clearfield Job Corps Center used the Test of Adult Basic Edu- 
cation to pre- and post-program-test the Davis County literacy program 
participants. Of the 49 participants originally enrolled in the program, 
36 were both pre- and post-program-tested, according to program data. 
Of the remaining 13 youths, 9 dropped out of the program and 4 were 
not present on the day of post-program-testing, a program official said. 

Most of the youths in the literacy program showed an increase in their 
level of performance by the end of the summer program. Of the 36 
youths post-program-tested, 34 (94 percent) increased their reading 
scores, while 2 (6 percent) declined. The average reading score increase 
was 2.4 grade levels— ranging from 0.6 to 6.0 grade levels. In math, 27 
youths (75 percent) increased their grade level performance, while 7 (19 
percent) declined, and 2 (6 ^ercent) remained the same. The average 
gain for math scores was 1.1 grade levels — ranging from 01 to 3.3 grade 
levels — and the average decrease was 0.65 of a grade level-ranging 
from 0.2 to 0.9 of a grade level. 
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Outcomes of the 1987 srerp tests indicated the literacy program was suc- 
cessful, according to a Davis County PIC report. The program met the 
objective of raising the reading levels of 90 percent of the participants 
by one grade level, the test data indicated, but fell short in math for 
which the objective was the same. Of the 36 youths pre- and post-pro- 
gram-tested, 33 (92 percent) raised their reading grade level by at ieast 
one grade. In math, however, only 14 youths (39 percent) raised their 
scores by at least one grade level. 

The program met another quantifiable goal in 1987 — to have 50 percent 
of its participants earn high school credits for their participation during 
the summer, according to the Pic report. The program recommended 40 
of the enrolled 49 youths (82 percent) for full or partial high school 
credit upon completion of the 1987 srerp, according to a program offi- 
cial. But she could not confirm how many of the youths' schools abided 
by the recommendations. 



Implementation 
Difficulties and 1988 
Program 



The 1987 SV'etp in Davis County was implemented smoothly because it 
was pilot-tested the previous year, according to the program's Assistant 
Director. The new jtpa amendments had no significant impact on the 
design of the progrcan, she said. One planning concern identified by the 
staff was uncertainty over how much money the program would 
receive. In past years, they said, the program received supplemental 
JTPA funds midway through the summer program but could not count on 
these funus being available. Thus, it had to build in a contingency plan 
to add youths to the program in case the money was authorized. In 1987, 
the program had a waiting list of 50 youths who were interested in get- 
ting into the program, according to the Assistant Director, if supplemen- 
tal funds were authorized. She added that, as they did not receive 
additional funds, the youths on the waiting list received no services. 



The program made no changes in its 1988 program, according to this 
official. The program ran smoothly in its third year, she said, and 
accomplished its goals. 
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Figure 2.2 



Figure 2.5 



Criteria used 


Percent of 


SDAs 


Reao'ing and math tests 


80 


Recommendation from teachers 


72 


Grades from schools 


65 


Requests from the youth and/or parent 


46 




Remedial education providers 


Percent of 


SDAs 


Local school districts 


71 


Postsecondary institutions 


42 


Vocational, technical institutions 


31 


Community-based organizations 


27 


SDA staff 


18 



Figure 2.8 



Remediation content 


Percent of 


SDAs 


Primarily academic remediation 


77 


Remediation was focused on world*of*work issues 


14 


Provided remediation specific to the job in which each was placed 


3 



Figure 2.10 



FigurG m.1 





Service provided 


Average weekly hours 
in remediation and 
work activities 


Remediation 


14 


Work (remediation participants) 


21 


Work (nonremediation participants) 


32 






Ages 


No. of participants 
Mail Female 


14-15 


8 3 


16-17 


23 25 


18-21 


12 21 



80 
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Figure 111.3 



Ages 


No. of participants 
Male Female 


14-15 


32 


71 


16-17 


11 


25 


18-21 


0 


11 






Ages 


No. of participants 
Male Female 


14-15 


250 


163 


16-17 


205 


166 


18-21 


42 


34 



Figure 111.5 



Figure III.7 



No. of participants 



Ages Male Female 



14-15 


15 


7 


16-17 


2 


4 


18 and up 


0 


0 






Ages 


No. of participants 
Male Female 


14-15 


23 


25 


16-17 


13 


18 


18-21 


0 


7 



Figure 111.9 



Figure 111.11 



No. of participants 



Ages Male Female 



14-15 




0 0 


16-17 




21 23 


18-21 




23 17 






Ages 




'*o. of participants 
Male Female 


14-15 




33 37 


16-17 




72 68 


18 and up 




12 21 


Page 91 


91 


GAO/HRD-88-118 Remedial Education in Sununer Jobs Program 



Ff'gure 111.13 



Appendix IV 

Data Supporting Figures in Report Text 



Figure 111.15 





Ages 


No. of particioants 


Male Female 


14-15 


7 2 


16-17 


20 12 


18 and up 


2 6 



• 
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